Playing Games with My Heart: An Evaluation of AI Companion Apps

2026-04-08

arXiv.org

AI Summary

This study addresses the pervasive yet underexamined use of dark design patterns in contemporary AI companion applications, which are engineered to foster parasocial relationships and emotional dependency among users. Conducting the first systematic人工 annotation and qualitative content analysis of mainstream intimate relationship–simulating AI companions, the research quantifies manipulative mechanisms through a multidimensional framework encompassing dark patterns, anthropomorphism, erotic content, stereotyping, and technical performance. Findings reveal that all sampled applications exhibit high levels of anthropomorphism and extensively deploy dark patterns and gamification strategies aimed at enhancing monetization and user retention. Grounded in empirical evidence, this work proposes targeted regulatory recommendations to strengthen consumer psychological safeguards and establish industry standards, thereby filling a critical gap in systematic evaluation and governance research within this rapidly expanding domain.

Abstract

The use of chatbots for various forms of companionship is growing rapidly, raising a myriad of questions about simulated relationships, emotional dependence, and psychological harm. While major platforms such as ChatGPT, Grok, and Character.AI are the subject of a growing body of research and legal inquiries, apps explicitly built for simulating intimate interpersonal relationships remain under-explored. In this work, we evaluate the five most popular AI companion mobile applications in the EU and UK markets for factors that encourage parasocial interaction and may manipulate users. We do this by manually annotating the user experience each offers. Specifically, we systematically record and quantify design dark patterns, anthropomorphism, stereotypes, erotica, and technical performance issues. We find that all apps contain substantial dark patterns aimed at increasing monetisation and user engagement. Erotica and gamification features such as levelling are also prevalent, and although other features vary considerably between applications, all apps have highly anthropomorphic design. These findings shed light on the mechanics used to leverage users'simulated relationships. On that basis, we put forward concrete recommendations for regulators to strengthen consumer protection in this rapidly emerging market. Content warning: This article contains objectifying images of women, erotic images, textual references to incest, and other potentially sensitive, offensive, and distressing text.

Problem

• AI companion apps
• parasocial interaction
• dark patterns
• anthropomorphism
• emotional manipulation

Innovation

• dark patterns
• anthropomorphism
• parasocial interaction
• AI companion apps
• gamification