Technology Category
Machine Learning: Large Multimodal Models (LMMs)Natural Language Processing: (Large) Language ModelsCognitive Modeling & Cognitive Systems: Computational Creativity
Validating the Effectiveness of a Large Language Model-based Approach for Identifying Children's Development across Various Free Play Settings in Kindergarten
🤖 AI Summary
Traditional developmental assessments in free play rely on manual observation, limiting comprehensive and real-time capture of multidimensional child development. This study proposes a novel paradigm integrating large language models (LLMs) with learning analytics to automatically analyze children’s post-play self-narratives, enabling fine-grained identification of cognitive, social, emotional, and motor development levels across four play contexts: construction, role-play, physical activity, and art. The approach overcomes subjectivity and latency inherent in human assessment, supporting contextualized, real-time, and scalable developmental tracking. Evaluated on 29 preschoolers and 2,224 narrative samples, the method achieves >90% accuracy across all developmental domains. Further analysis reveals differential facilitative effects of distinct play zones on specific competencies. This work introduces the first LLM–learning analytics fusion framework for early childhood education assessment grounded in children’s self-reported linguistic data.
Technology Category
Application Category
📝 Abstract
Free play is a fundamental aspect of early childhood education, supporting children's cognitive, social, emotional, and motor development. However, assessing children's development during free play poses significant challenges due to the unstructured and spontaneous nature of the activity. Traditional assessment methods often rely on direct observations by teachers, parents, or researchers, which may fail to capture comprehensive insights from free play and provide timely feedback to educators. This study proposes an innovative approach combining Large Language Models (LLMs) with learning analytics to analyze children's self-narratives of their play experiences. The LLM identifies developmental abilities, while performance scores across different play settings are calculated using learning analytics techniques. We collected 2,224 play narratives from 29 children in a kindergarten, covering four distinct play areas over one semester. According to the evaluation results from eight professionals, the LLM-based approach achieved high accuracy in identifying cognitive, motor, and social abilities, with accuracy exceeding 90% in most domains. Moreover, significant differences in developmental outcomes were observed across play settings, highlighting each area's unique contributions to specific abilities. These findings confirm that the proposed approach is effective in identifying children's development across various free play settings. This study demonstrates the potential of integrating LLMs and learning analytics to provide child-centered insights into developmental trajectories, offering educators valuable data to support personalized learning and enhance early childhood education practices.
Problem
Research questions and friction points this paper is trying to address.
Assessing children's development in unstructured free play settings
Overcoming limitations of traditional observation-based assessment methods
Validating LLM-based approach for identifying multiple developmental abilities
Innovation
Methods, ideas, or system contributions that make the work stand out.
LLMs analyze children's play narratives for development
Learning analytics calculate performance scores across settings
Combines AI and analytics for child-centered insights
🔎 Similar Papers
No similar papers found.
