Hierarchical Working Memory and a New Magic Number

2024-08-14

bioRxiv

AI Summary

Working memory overcomes the “magical number four” capacity limit via hierarchical chunking, yet its underlying neural mechanisms remain unclear. Methodologically, we propose a recurrent neural network model grounded in synaptic persistent activity theory, enabling the online self-organization, efficient maintenance, and retrieval of dynamic hierarchical representations—achieved by integrating single-neuron biophysical modeling, behavioral experiments, and analytical derivation. The model successfully reproduces human chunking behavior and associated neural response profiles. Theoretically, we derive a novel memory capacity bound dependent solely on elementary storage capacity. Empirically, predictions are validated against both single-neuron recordings from epilepsy patients and behavioral speech-memory experiments. Our core contribution is the demonstration that working memory can generate multi-level abstract representations in real time, thereby establishing a critical mechanistic bridge between neurodynamical principles and cognitive chunking.

Technology Category

• Cognitive Modeling & Cognitive Systems: Neural Spike Coding
• Natural Language Processing: Syntax — Tagging, Chunking & Parsing
• Machine Learning: Deep Learning Theory

Application Category

• Web Mining and Content Analysis: Models for Web evolution
• User Modeling, Personalization and Recommendation: Psychology-informed user models and recommender systems
• Search and Retrieval-Augmented AI: Efficiency and scalability of Web search engines

Abstract

The extremely limited working memory span, typically around four items, contrasts sharply with our everyday experience of processing much larger streams of sensory information concurrently. This disparity suggests that working memory can organize information into compact representations such as chunks, yet the underlying neural mechanisms remain largely unknown. Here, we propose a recurrent neural network model for chunking within the framework of the synaptic theory of working memory. We showed that by selectively suppressing groups of stimuli, the network can maintain and retrieve the stimuli in chunks, hence exceeding the basic capacity. Moreover, we show that our model can dynamically construct hierarchical representations within working memory through hierarchical chunking. A consequence of this proposed mechanism is a new limit on the number of items that can be stored and subsequently retrieved from working memory, depending only on the basic working memory capacity when chunking is not invoked. Predictions from our model were confirmed by analyzing single-unit responses in epileptic patients and memory experiments with verbal material. Our work provides a novel conceptual and analytical framework for understanding the on-the-fly organization of information in the brain that is crucial for cognition.

Problem

• Neural mechanism for spontaneous chunking in working memory
• Synaptic plasticity enabling formation of chunk representations
• Dynamic construction of hierarchical representations through chunking

Innovation

• Synaptic plasticity enables chunk formation
• Specialized chunking neurons control stimulus groups
• Hierarchical chunking constructs dynamic memory representations