Can Theory-Informed Message Framing Drive Honest and Motivated Performance with Better Assessment Experiences in a Remote Assessment?

2026-02-04

AI Summary

This study addresses the theoretical underpinnishment of informational interventions in remote proctoring, which have predominantly focused on suppressing cheating while neglecting effects on test-takers’ performance and experience, and often conceptualizing cheating as a binary behavior. Integrating 15 psychological constructs—including self-determination theory and cognitive dissonance—the authors propose the first theory-driven framework for informational interventions. Through an expert workshop, they developed 45 tailored prompts and tested them in a large-scale incentivized online experiment (N = 1,232), employing a tripartite cheating classification (non-cheating, partial cheating, full cheating) to enable causal inference. Results show that autonomy-supportive motivational messages significantly reduced full cheating by 42% (from 33% to 19%) and increased non-cheating by 19% (from 53% to 63%), with no adverse effects on performance or experience across any integrity group, revealing a more nuanced psychological mechanism than previously theorized.

Technology Category

• Game Theory and Economic Paradigms: Imperfect Information
• Multiagent Systems: Mechanism Design
• Cognitive Modeling & Cognitive Systems: Social Cognition And Interaction

Application Category

• Economics, Online Markets and Human Computation: LLM based quality controls for crowd work
• User Modeling, Personalization and Recommendation: Psychology-informed user models and recommender systems
• Responsible Web: Mitigating online harms, including harassment, spam, and fake reviews

Abstract

Remote unproctored assessments increasingly use messaging interventions to reduce cheating, but existing approaches lack theoretical grounding, focus narrowly on cheating suppression while overlooking performance and experience, and treat cheating as binary rather than continuous. This study examines whether messages based on 15 psychological concepts from self-determination, cognitive dissonance, social norms, and self-efficacy theories can reduce cheating while preserving performance and experience. Through an expert workshop (N=5), we developed 45 theory-informed messages and tested them with online participants (N=1232) who completed an incentivized anagram task. Participants were classified as non-cheaters (0% items cheated), partial-cheaters (1-99% cheated), or full-cheaters (100% cheated). Results show that concept-based messages reduced full-cheating occurrence by 42% (33% to 19%), increased non-cheating by 19% (53% to 63%), with no negative effects on performance or experience across integrity groups. Surprisingly, messages grounded in different theoretical concepts produced virtually identical effects. Analyses of self-rated psychological mechanisms revealed that messages influenced multiple mechanisms simultaneously rather than their intended targets, though these mechanisms predicted behavior, performance, and experience. These findings show that causal pathways are more complex than current theories predict. Practically, integrity interventions using supportive motivation rather than rule enforcement can reduce cheating without impairing performance or experience.

Problem

• remote assessment
• cheating reduction
• message framing
• performance preservation
• assessment experience

Innovation

• theory-informed messaging
• remote assessment integrity
• motivational intervention
• cheating as continuous behavior
• psychological mechanisms