Unexpected but informative: What fixation-related potentials tell us about the processing of confusing program code

2024-12-13

AI Summary

This study investigates the real-time neurocognitive mechanisms underlying programmers’ processing of “confusing atoms”—syntactically valid but semantically ambiguous code fragments. Method: Using synchronized eye-tracking and high-density EEG in ecologically valid programming tasks, we extracted fixation-related potentials (FRPs), introducing the FRP paradigm to program comprehension research for the first time. Contribution/Results: Confusing atoms elicited a late prefrontal positive wave (LPN) peaking at 400–700 ms post-fixation; its temporal, spatial, and functional profile closely matches the context-updating component observed for “unexpected yet plausible” words in natural language processing. This constitutes the first empirical evidence that program comprehension and natural language comprehension share a dynamic situational model updating mechanism. The findings provide critical neuroscientific foundations for modeling code readability, designing intelligent IDE suggestions, and advancing human–AI collaborative programming.

Technology Category

• Natural Language Processing: Code Generation / Program Synthesis from Natural Language
• Cognitive Modeling & Cognitive Systems: Neural Spike Coding
• Humans and AI: Other Foundations of Human Computation & AI

Application Category

• Economics, Online Markets and Human Computation: Sustainability of Web economics
• User Modeling, Personalization and Recommendation: Practical large-scale studies of user experience
• Web Mining and Content Analysis: Models for Web evolution

Abstract

As software pervades more and more areas of our professional and personal lives, there is an ever-increasing need to maintain software, and for programmers to be able to efficiently write and understand program code. In the first study of its kind, we analyze fixation-related potentials (FRPs) to explore the online processing of program code patterns that are ambiguous to programmers, but not the computer (so-called atoms of confusion), and their underlying neurocognitive mechanisms in an ecologically valid setting. Relative to unambiguous counterparts in program code, atoms of confusion elicit a late frontal positivity with a duration of about 400 to 700 ms after first looking at the atom of confusion. As the frontal positivity shows high resemblance with an event-related potential (ERP) component found during natural language processing that is elicited by unexpected but plausible words in sentence context, we take these data to suggest that the brain engages similar neurocognitive mechanisms in response to unexpected and informative inputs in program code and in natural language. In both domains, these inputs lead to an update of a comprehender's situation model that is essential for information extraction from a quickly unfolding input.

Problem

• Analyzing neurocognitive mechanisms in processing confusing code
• Exploring fixation-related potentials for ambiguous program patterns
• Comparing code and language processing via brain responses

Innovation

• Analyzing fixation-related potentials (FRPs) for code processing
• Identifying late frontal positivity in confusing code patterns
• Comparing neurocognitive mechanisms between code and language