Understanding Gaming the System by Analyzing Self-Regulated Learning in Think-Aloud Protocols

2026-01-08

arXiv.org

AI Summary

This study investigates whether students’ “gaming the system” behavior in intelligent tutoring systems reflects cognitive disengagement or instead constitutes an alternative form of self-regulated learning (SRL). Employing a mixed-methods approach that integrates think-aloud protocols, interaction logs, and SRL coding, the research compares students’ cognitive engagement during gaming versus non-gaming episodes. Findings reveal that during gaming periods, students produce longer verbalizations and more frequently engage in information processing and error identification, yet exhibit significantly reduced planning behaviors, indicating a reactive rather than proactive SRL profile. These results provide the first evidence from cognitive and SRL perspectives that gaming the system may represent a maladaptive SRL strategy rather than mere cognitive disengagement, offering new insights into strategic behaviors in digital learning environments.

Technology Category

• Cognitive Modeling & Cognitive Systems: Adaptive Behavior
• Game Theory and Economic Paradigms: Adversarial Learning
• Intelligent Robots: Behavior Learning & Control

Application Category

• User Modeling, Personalization and Recommendation: Studies of user behavior, including longitudinal effects of personalized systems
• Semantics and Knowledge: Data modeling to support human-machine intelligence, including LLMs agents, intelligent system behavior, explanations, and user-friendly interactions
• Responsible Web: Machine-in-the-loop, human agency and autonomy

Abstract

In digital learning systems, gaming the system refers to occasions when students attempt to succeed in an educational task by systematically taking advantage of system features rather than engaging meaningfully with the content. Often viewed as a form of behavioral disengagement, gaming the system is negatively associated with short- and long-term learning outcomes. However, little research has explored this phenomenon beyond its behavioral representation, leaving questions such as whether students are cognitively disengaged or whether they engage in different self-regulated learning (SRL) strategies when gaming largely unanswered. This study employs a mixed-methods approach to examine students'cognitive engagement and SRL processes during gaming versus non-gaming periods, using utterance length and SRL codes inferred from think-aloud protocols collected while students interacted with an intelligent tutoring system for chemistry. We found that gaming does not simply reflect a lack of cognitive effort; during gaming, students often produced longer utterances, were more likely to engage in processing information and realizing errors, but less likely to engage in planning, and exhibited reactive rather than proactive self-regulatory strategies. These findings provide empirical evidence supporting the interpretation that gaming may represent a maladaptive form of SRL. With this understanding, future work can address gaming and its negative impacts by designing systems that target maladaptive self-regulation to promote better learning.

Problem

• gaming the system
• self-regulated learning
• cognitive engagement
• think-aloud protocols
• maladaptive SRL

Innovation

• gaming the system
• self-regulated learning
• think-aloud protocols
• maladaptive SRL
• intelligent tutoring systems