Embodied Empathy: A Multimodal AR and LLM-Powered System for Self-Attachment Psychotherapy with Self-Initiated Humour

2026-08-03

AI Summary

This study addresses the growing disparity between surging demand for mental health services and limited professional resources by proposing a scalable digital intervention. The work introduces a novel virtual therapist system that uniquely integrates self-attachment therapy, augmented reality (AR), and large language models (LLMs) to generate customizable 3D childhood avatars. Through embodied interaction, emotion recognition and mirroring, and proactive dialogue driven by a user-co-created humor protocol, the system enhances users’ emotional connection and empathic engagement. An eight-day user study (N=16) demonstrated significant improvements in self-reported mood; personalized avatars and voice output effectively fostered emotional attachment, while the efficacy of emotion mirroring was modulated by classification accuracy and animation intensity. This research establishes a new paradigm for digital mental health interventions.

Abstract

The growing global demand for mental health support increasingly exceeds the supply of qualified practitioners, creating an urgent need for scalable digital interventions that can deliver meaningful emotional connection. In response, we present a novel multimodal application that operationalises the Self-Initiated Humour Protocol (SIHP) within a Self-Attachment Technique (SAT) framework. Our mobile application integrates customisable 3D childhood avatars, augmented reality, and an LLM-driven virtual therapist capable of automated emotion mirroring. An eight-day user study (N=16) indicates the system's feasibility and improvements in self-reported mood. Results show that personalised avatars and text-to-speech output strengthen emotional bonding and perceived empathy. Although emotion mirroring boosts engagement, its effectiveness depends heavily on classification accuracy and animation intensity. Moreover, findings indicate a shift in user expectations--from reactive chatbots to proactive conversational facilitators. We conclude with design implications for leveraging AI and AR to cultivate embodied empathy in digital mental health tools.

Problem

• mental health
• digital intervention
• emotional connection
• self-attachment therapy
• embodied empathy

Innovation

• Embodied Empathy
• Multimodal AR
• LLM-Powered Virtual Therapist
• Self-Attachment Therapy
• Emotion Mirroring