Reading Between the Lines: How Electronic Nonverbal Cues shape Emotion Decoding

2026-03-21

AI Summary

This study addresses how users accurately interpret emotions in text-based communication devoid of physical cues by leveraging electronic nonverbal cues (eNVCs). Grounded in classical nonverbal communication theory, it proposes the first unified taxonomy of eNVCs and systematically investigates their role in emotion decoding within microblogging contexts through an integrated approach combining survey experiments and focus groups. Findings reveal that eNVCs significantly enhance emotion recognition accuracy and reduce perceived ambiguity, with users tending to adopt more negative interpretations in ambiguous contexts. Additionally, the project delivers an extensible, open-source toolkit for automatic eNVC detection implemented in Python and R, offering both theoretical insights and practical resources for affective computing and emotion-aware interface design.

Technology Category

• Natural Language Processing: Ethics — Bias, Fairness, Transparency & Privacy
• Cognitive Modeling & Cognitive Systems: Affective Computing
• Humans and AI: Emotional Intelligence

Application Category

• Economics, Online Markets and Human Computation: Data quality aspects of human-annotated datasets
• Web Mining and Content Analysis: Sentiment analysis and opinion mining
• User Modeling, Personalization and Recommendation: Practical large-scale studies of user experience

Abstract

As text-based computer-mediated communication (CMC) increasingly structures everyday interaction, a central question re-emerges with new urgency: How do users reconstruct nonverbal expression in environments where embodied cues are absent? This paper provides a systematic, theory-driven account of electronic nonverbal cues (eNVCs) - textual analogues of kinesics, vocalics, and paralinguistics - in public microblog communication. Across three complementary studies, we advance conceptual, empirical, and methodological contributions. Study 1 develops a unified taxonomy of eNVCs grounded in foundational nonverbal communication theory and introduces a scalable Python toolkit for their automated detection. Study 2, a within-subject survey experiment, offers controlled causal evidence that eNVCs substantially improve emotional decoding accuracy and lower perceived ambiguity, while also identifying boundary conditions, such as sarcasm, under which these benefits weaken or disappear. Study 3, through focus group discussions, reveals the interpretive strategies users employ when reasoning about digital prosody, including drawing meaning from the absence of expected cues and defaulting toward negative interpretations in ambiguous contexts. Together, these studies establish eNVCs as a coherent and measurable class of digital behaviors, refine theoretical accounts of cue richness and interpretive effort, and provide practical tools for affective computing, user modeling, and emotion-aware interface design. The eNVC detection toolkit is available as a Python and R package at https://github.com/kokiljaidka/envc.

Problem

• electronic nonverbal cues
• emotion decoding
• computer-mediated communication
• text-based interaction
• digital prosody

Innovation

• electronic nonverbal cues
• emotion decoding
• automated detection
• digital prosody
• affective computing