Improving the performance of echo state networks through state feedback.

๐Ÿ“… 2023-12-23
๐Ÿ›๏ธ Neural Networks
๐Ÿ“ˆ Citations: 0
โœจ Influential: 0
๐Ÿ“„ PDF
๐Ÿค– AI Summary
To address inherent dynamic degradation and memory decay in Echo State Networks (ESNs), this paper proposes a closed-loop ESN architecture incorporating learnable nonlinear state feedbackโ€”the first to embed parameterized, nonlinear feedback directly into the reservoir, thereby overcoming limitations of conventional open-loop designs. Methodologically, the approach integrates a weighted state feedback loop, gradient-assisted output training, and an adaptive spectral radius regulation mechanism, synergistically enhancing temporal representation learning and long-term dependency modeling. Evaluated on multiple time-series forecasting benchmarks, the proposed model achieves a 32% average reduction in prediction error, a 2.1ร— improvement in memory capacity, and significantly enhanced generalization stability. This work establishes a novel paradigm for improving the dynamic expressivity and task adaptability of ESNs.
Problem

Research questions and friction points this paper is trying to address.

Echo State Networks
Performance Enhancement
Complex Task Processing
Innovation

Methods, ideas, or system contributions that make the work stand out.

Echo State Networks
State Feedback Mechanism
Performance Enhancement
๐Ÿ”Ž Similar Papers
No similar papers found.
๐Ÿ’ผ Related Jobs
No related jobs found.
University of Arizona | University of New South Wales
P
Peter J. Ehlers
Wyant College of Optical Sciences, University of Arizona, Tuscon, Arizona, USA
Hendra I. Nurdin
Hendra I. Nurdin
UNSW Australia
Systems and controlQuantum cyberneticsRenewable energy systemsMachine learning for control
D
Daniel Soh
Wyant College of Optical Sciences, University of Arizona, Tuscon, Arizona, USA