Mental Health Generative AI is Safe, Promotes Social Health, and Reduces Depression and Anxiety: Real World Evidence from a Naturalistic Cohort

2025-11-12

AI Summary

Ensuring the safety, personalization, and scalability of generative AI (GAI) chatbots for mental health support remains a critical challenge in real-world deployment. Method: We conducted a naturalistic longitudinal cohort study involving a 6-week intervention with 10-week follow-up, integrating PHQ-9/GAD-7 assessments, growth mixture modeling, and embedded automated safety guardrails for dynamic symptom monitoring and real-time risk mitigation. Contribution/Results: Participants exhibited statistically significant reductions in depression and anxiety symptoms (p < 0.001), sustained through follow-up; concurrent improvements were observed in social functioning and psychological resilience. Working alliance scores met established benchmarks for face-to-face psychotherapy. All 76 identified risk events were promptly and effectively managed. This study provides the first empirical evidence—within authentic clinical contexts—that GAI systems can deliver safe, scalable, and evidence-based psychological interventions, establishing a foundational validation for large-scale digital mental health services.

Technology Category

• Natural Language Processing: Safety and Robustness
• Intelligent Robots: Embodied AI
• Philosophy and Ethics of AI: Safety, Robustness & Trustworthiness

Application Category

• Social Networks and Social Media: Generative AI / large language models and their impact on social systems
• Economics, Online Markets and Human Computation: Trust and reliance of crowd workers and data experts on GenAI
• Security and Privacy: Large-scale security measurements

Abstract

Generative artificial intelligence (GAI) chatbots built for mental health could deliver safe, personalized, and scalable mental health support. We evaluate a foundation model designed for mental health. Adults completed mental health measures while engaging with the chatbot between May 15, 2025 and September 15, 2025. Users completed an opt-in consent, demographic information, mental health symptoms, social connection, and self-identified goals. Measures were repeated every two weeks up to 6 weeks, and a final follow-up at 10 weeks. Analyses included effect sizes, and growth mixture models to identify participant groups and their characteristic engagement, severity, and demographic factors. Users demonstrated significant reductions in PHQ-9 and GAD-7 that were sustained at follow-up. Significant improvements in Hope, Behavioral Activation, Social Interaction, Loneliness, and Perceived Social Support were observed throughout and maintained at 10 week follow-up. Engagement was high and predicted outcomes. Working alliance was comparable to traditional care and predicted outcomes. Automated safety guardrails functioned as designed, with 76 sessions flagged for risk and all handled according to escalation policies. This single arm naturalistic observational study provides initial evidence that a GAI foundation model for mental health can deliver accessible, engaging, effective, and safe mental health support. These results lend support to findings from early randomized designs and offer promise for future study of mental health GAI in real world settings.

Problem

• Evaluating safety and effectiveness of mental health AI chatbots
• Assessing AI's impact on depression and anxiety symptoms reduction
• Measuring social health improvements through generative AI interventions

Innovation

• Foundation model designed for mental health support
• Automated safety guardrails with risk escalation policies
• Growth mixture models to analyze engagement patterns