Many hands make light work: An LLM-based multi-agent system for detecting malicious PyPI packages

📅 2026-01-17
🏛️ Journal of Systems and Software
📈 Citations: 0
✨ Influential: 0
📄 PDF
🤖 AI Summary
This work proposes LAMPS, a multi-agent collaborative system based on large language models (LLMs) to detect malicious packages in the PyPI repository that exhibit strong semantic obfuscation and evade traditional rule-based detection methods. LAMPS employs a modular architecture coordinated via the CrewAI framework, integrating four specialized agents that synergistically combine fine-tuned CodeBERT for classification and LLaMA-3 for contextual reasoning. This approach enables high-precision, interpretable, and scalable supply chain security analysis. Evaluated on the D1 and D2 datasets, LAMPS achieves accuracy rates of 97.7% and 99.5%, respectively, significantly outperforming baseline methods including MPHunter, retrieval-augmented generation (RAG), and single-agent approaches, thereby overcoming the limitations of individual models in recognizing complex malicious behavioral patterns.

Technology Category

Machine Learning: Large Multimodal Models (LMMs)Multiagent Systems: Coordination and CollaborationNatural Language Processing: Safety and Robustness

Application Category

Search and Retrieval-Augmented AI: Agentic searchSemantics and Knowledge: Data modeling to support human-machine intelligence, including LLMs agents, intelligent system behavior, explanations, and user-friendly interactionsGraph Algorithms and Modeling for the Web: Foundation models and LLMs for Web-related graphs
Problem

Research questions and friction points this paper is trying to address.

malicious code detection
software supply chain security
PyPI packages
open-source repositories
adversarial components
Innovation

Methods, ideas, or system contributions that make the work stand out.

multi-agent system
large language models
malicious package detection
software supply chain security
modular LLM reasoning
🔎 Similar Papers
No similar papers found.
💼 Related Jobs
No related jobs found.
M
Muhammad Umar Zeshan
Università degli studi dell’Aquila, 67100 L’Aquila, Italy
M
Motunrayo Ibiyo
Università degli studi dell’Aquila, 67100 L’Aquila, Italy
Claudio Di Sipio
Claudio Di Sipio
Post-doc researcher, ISSE, Johannes Kepler University
Recommendation SystemsSoftware EngineeringAI4SEModel-Driven EngineeringVideo games
P
Phuong T. Nguyen
Università degli studi dell’Aquila, 67100 L’Aquila, Italy
D
D. D. Ruscio
Università degli studi dell’Aquila, 67100 L’Aquila, Italy