Mitigating"Epistemic Debt"in Generative AI-Scaffolded Novice Programming using Metacognitive Scripts

2026-02-22

AI Summary

Unconstrained use of generative AI in programming can lead novices to accumulate “cognitive debt,” resulting in “fragile experts” who produce code prolifically yet lack long-term maintainability. This study proposes an “explanation gate” mechanism that mandates learners to “teach back” their understanding before AI-generated code is provided. Integrating metacognitive scripting with an LLM-as-a-Judge real-time assessment framework, the approach introduces metacognitive friction into programming education for the first time, shifting AI usage from cognitive outsourcing to cognitive offloading. A between-subjects experiment (N=78) using a Cursor IDE plugin built on Claude 3.5 Sonnet showed comparable productivity between groups on routine tasks; however, when AI was disabled during maintenance tasks, the unconstrained group exhibited a 77% failure rate compared to only 39% in the scaffolded group, demonstrating the method’s efficacy in mitigating cognitive debt and enhancing long-term code maintainability.

Technology Category

• Natural Language Processing: Code Generation / Program Synthesis from Natural Language
• Cognitive Modeling & Cognitive Systems: Computational Creativity
• Machine Learning: Large Multimodal Models (LMMs)

Application Category

• Economics, Online Markets and Human Computation: Cost models of using LLMs in production systems
• Semantics and Knowledge: Data modeling to support human-machine intelligence, including LLMs agents, intelligent system behavior, explanations, and user-friendly interactions
• Search and Retrieval-Augmented AI: Search Tool Learning with LLM: Teaching LLMs to invoke search and make use of retrieved information

Abstract

The democratization of Large Language Models (LLMs) has given rise to ``Vibe Coding,"a workflow where novice programmers prioritize semantic intent over syntactic implementation. While this lowers barriers to entry, we hypothesize that without pedagogical guardrails, it is fundamentally misaligned with cognitive skill acquisition. Drawing on the distinction between Cognitive Offloading and Cognitive Outsourcing, we argue that unrestricted AI encourages novices to outsource the Intrinsic Cognitive Load required for schema formation, rather than merely offloading Extraneous Load. This accumulation of ``Epistemic Debt"creates ``Fragile Experts"whose high functional utility masks critically low corrective competence. To quantify and mitigate this debt, we conducted a between-subjects experiment (N=78) using a custom Cursor IDE plugin backed by Claude 3.5 Sonnet. Participants represented"AI-Native"learners across three conditions: Manual (Control), Unrestricted AI (Outsourcing), and Scaffolded AI (Offloading). The Scaffolded condition utilized a novel ``Explanation Gate,"leveraging a real-time LLM-as-a-Judge framework to enforce a ``Teach-Back"protocol before generated code could be integrated. Results reveal a ``Collapse of Competence": while Unrestricted AI users matched the productivity of the Scaffolded group (p<.001 vs. Manual), they suffered a 77% failure rate in a subsequent AI-Blackout maintenance task, compared to only 39% in the Scaffolded group. Qualitative analysis suggests that successful vibe coders naturally engage in self-scaffolding, treating the AI as a consultant rather than a contractor. We discuss the implications for the maintainability of AI-generated software and propose that future learning systems must enforce Metacognitive Friction to prevent the mass production of unmaintainable code.

Problem

• Epistemic Debt
• Cognitive Outsourcing
• Novice Programming
• Vibe Coding
• Maintainability

Innovation

• Metacognitive Scripts
• Explanation Gate
• Cognitive Outsourcing
• Epistemic Debt
• LLM-as-a-Judge