🤖 AI Summary
This study addresses the limitation of existing cognitive taxonomies in neglecting the practical impact of command-line operations on computing systems, which hinders effective instruction and assessment. To overcome this, the authors propose a novel four-tier cognitive classification framework that integrates Bloom’s taxonomy with a new operational-impact dimension comprising observability, reversibility, structurality, and manageability. Task difficulty is innovatively defined as the maximum of the two dimensions. By combining abstract syntax tree–based syntactic representations with semantic embeddings, the authors develop an automated classifier that achieves 89% accuracy on a dataset of 585 expert-annotated Linux/bash commands—significantly outperforming models relying on either representation alone. The approach also demonstrates strong generalizability through structural equivalence across different command languages.
📝 Abstract
As computing education expands beyond traditional programming into operational domains such as systems administration and command-line environments, existing pedagogical frameworks struggle to capture a dimension that is critical in these contexts: the real-world consequences of learner actions. Existing cognitive taxonomies classify learning objectives by mental operations but do not account for system impact, leaving a critical gap in command-line education where conceptually simple commands can have severe consequences. This work presents CogTax, a four-level cognitive taxonomy that integrates two dimensions: cognitive complexity, derived from Bloom's Revised Taxonomy, and operational impact, which distinguishes observational, reversible, structural, and administrative operations. The four progressive levels range from safe read-only inspection to advanced system management requiring integration of multiple abstract models. Then, the taxonomy level is defined as the maximum of these dimensions, ensuring that both conceptual understanding and operational awareness are addressed. CogTax gives instructors a principled framework for sequencing course material and calibrating assessment difficulty, and gives students an explicit reference for self-assessment and gap identification. To demonstrate that taxonomy levels are automatically assignable, making the framework scalable without manual expert annotation, a classifier that combines syntactic representations derived from abstract syntax trees with semantic embeddings is trained. Evaluated on 585 expert-annotated Linux/bash commands, this combined approach achieves 89% accuracy, outperforming either representation alone, and demonstrates cross-language extensibility through structural equivalences across command languages.