Social bot detection in the age of ChatGPT: Challenges and opportunities

2026-10-01

AI Summary

This study addresses the severe challenges that large language model (LLM)-driven social bots, such as those powered by ChatGPT, pose to traditional detection techniques by systematically analyzing the limitations of existing methods. To overcome these shortcomings, this work proposes a novel detection framework integrating synthetic data from generative agents, multimodal cross-platform behavioral features, and federated learning, thereby extending applicability to non-English contexts while preserving privacy. Furthermore, this research identifies emerging detection opportunities within AI-generated conversational environments. Ultimately, it delineates a clear roadmap for future research toward collaborative, multimodal detection architectures capable of countering next-generation LLM-powered social bots.

Abstract

We present a comprehensive overview of the challenges and opportunities in social bot detection in the context of the rise of sophisticated AI-based chatbots. By examining the state of the art in social bot detection techniques and the more salient real-world application to date, we identify gaps and emerging trends in the field, with a focus on addressing the unique challenges posed by AI-generated conversations and behaviors. We suggest potentially promising opportunities and research directions in social bot detection, including (i) the use of generative agents for synthetic data generation, testing and evaluation; (ii) the need for multimodal and cross-platform detection based on network and behavioral signatures of coordination and influence; (iii) the opportunity to extend bot detection to non-English and low-resource language settings; and, (iv) the room for development of collaborative, federated learning detection models that can help facilitate cooperation between different organizations and platforms while preserving user privacy.

Problem

• Social bot detection
• AI-generated conversations
• ChatGPT
• Multimodal detection
• Cross-platform detection

Innovation

• Social bot detection
• Generative agents
• Multimodal detection
• Federated learning
• Synthetic data generation