Technology Category
Cognitive Modeling & Cognitive Systems: Neural Spike CodingData Mining & Knowledge Management: Mining of Spatial, Temporal or Spatio-Temporal DataKnowledge Representation and Reasoning: Computational Complexity of Reasoning
Temporal Complexity and Self-Organization in an Exponential Dense Associative Memory Model
🤖 AI Summary
This study investigates how temporal complexity and self-organized criticality spontaneously emerge in exponential dense associative memory (DAM) models under nonequilibrium dynamics. By introducing temporal complexity theory into the exponential DAM framework for the first time, the authors combine neural avalanche detection, stochastic dynamical simulations, and scale-invariance statistical analyses to demonstrate that the model exhibits intermittent order–disorder transitions and scale-free temporal statistics within a finite noise regime. They further find that this critical regime slightly contracts as memory load increases, establishing a quantitative link between memory capacity and self-organizing capability. These results provide new empirical support for the extended criticality hypothesis in neural systems.
Technology Category
Application Category
📝 Abstract
Dense Associative Memory (DAM) models generalize the classical Hopfield model by incorporating n-body or exponential interactions that greatly enhance storage capacity. While the criticality of DAM models has been largely investigated, mainly within a statistical equilibrium picture, little attention has been devoted to the temporal self-organizing behavior induced by learning. In this work, we investigate the behavior of a stochastic exponential DAM (SEDAM) model through the lens of Temporal Complexity (TC), a framework that characterizes complex systems by intermittent transition events between order and disorder and by scale-free temporal statistics. Transition events associated with birth-death of neural avalanche structures are exploited for the TC analyses and compared with analogous transition events based on coincidence structures. We systematically explore how TC indicators depend on control parameters, i.e., noise intensity and memory load. Our results reveal that the SEDAM model exhibits regimes of complex intermittency characterized by nontrivial temporal correlations and scale-free behavior, indicating the spontaneous emergence of self-organizing dynamics. These regimes emerge in small intervals of noise intensity values, which, in agreement with the extended criticality concept, never shrink to a single critical point. Further, the noise intensity range needed to reach the critical region, where self-organizing behavior emerges, slightly decreases as the memory load increases. This study highlights the relevance of TC as a complementary framework for understanding learning and information processing in artificial and biological neural systems, revealing the link between the memory load and the self-organizing capacity of the network.
Problem
Research questions and friction points this paper is trying to address.
Temporal Complexity
Self-Organization
Dense Associative Memory
Neural Avalanches
Criticality
Innovation
Methods, ideas, or system contributions that make the work stand out.
Temporal Complexity
Self-Organization
Exponential Dense Associative Memory
Neural Avalanches
Extended Criticality
🔎 Similar Papers
2024-06-15arXiv.orgCitations: 0
