🤖 AI Summary
Autonomous evolution from situational awareness to tactical decision-making in multi-unmanned ground vehicle (UGV) adversarial scenarios remains challenging due to the lack of interpretable, end-to-end cognitive frameworks.
Method: This paper proposes a command architecture synergizing a vision-language model (VLM) and a lightweight large language model (LLM), enabling end-to-end coupling of perception understanding and strategic reasoning within a unified semantic space. It introduces the first explainable multi-agent tactical cognition model spanning the full “perception–cognition–decision” pipeline, emulating human commander reasoning.
Contribution/Results: Unlike rule-based or black-box reinforcement learning baselines, our approach significantly improves generalizability and decision interpretability. Simulation results demonstrate a win rate exceeding 80%; ablation studies validate the efficacy and robustness of each module.
📝 Abstract
In multiple unmanned ground vehicle confrontations, autonomously evolving multi-agent tactical decisions from situational awareness remain a significant challenge. Traditional handcraft rule-based methods become vulnerable in the complicated and transient battlefield environment, and current reinforcement learning methods mainly focus on action manipulation instead of strategic decisions due to lack of interpretability. Here, we propose a vision-language model-based commander to address the issue of intelligent perception-to-decision reasoning in autonomous confrontations. Our method integrates a vision language model for scene understanding and a lightweight large language model for strategic reasoning, achieving unified perception and decision within a shared semantic space, with strong adaptability and interpretability. Unlike rule-based search and reinforcement learning methods, the combination of the two modules establishes a full-chain process, reflecting the cognitive process of human commanders. Simulation and ablation experiments validate that the proposed approach achieves a win rate of over 80% compared with baseline models.