🤖 AI Summary
This work addresses the limited interpretability and lack of systematic optimization in traditional reservoir computing, which relies on randomly connected networks. Inspired by neural oscillatory mechanisms in the brain, the authors propose a frequency-decomposed reservoir architecture that allocates input signals across distinct frequency bands to dedicated forced nonlinear oscillator units. This design introduces an interpretable mechanism for frequency-selective amplification and memory retention. By integrating forced nonlinear oscillator theory—applied here for the first time in reservoir design—with linear readout layers and oscillator ensembles, the model enables targeted architectural optimization. Evaluated on time series and complex spatiotemporal forecasting tasks, the proposed approach matches or exceeds the performance of conventional random reservoirs while significantly enhancing short-term prediction accuracy.
📝 Abstract
Reservoir computing has emerged as an efficient machine learning framework for predicting time series generated by dynamical systems. In contrast to other machine and deep learning approaches, a reservoir computing trains only the output layer via linear regression, leaving the reservoir (recurrent layer) untrained. This simplification makes reservoir computers easier to train and more amenable to experimentation. However, because current reservoirs consist of networks of randomly connected nodes and require the optimization of numerous hyperparameters, a framework that precisely explains how reservoir computing operates and how it can be optimized remains missing. Here, we propose a frequency-based reservoir inspired by the brain's oscillatory dynamics and its hierarchy of timescales. The frequency-based reservoir can be interpreted as an ensemble of independent oscillatory units, each processing a portion of the input's frequency content.
This allows us to understand the reservoir's internal behavior by modeling it as a single unit driven by an external input. Borrowing from the theory of a nonlinear oscillator forced by complex periodic inputs, we found that units of the frequency-based reservoir selectively amplify and store specific input frequencies, which are then used for prediction. The frequency-based reservoir performs as well as or better than equivalent random reservoirs. Furthermore, the frequency-based approach can be optimized to improve short-term prediction, a property that random reservoirs lack. Finally, we show that the frequency-based reservoir can also predict complex spatiotemporal dynamics. Our results show that reservoir computing can be designed using brain properties and theoretical insights borrowed from the physics of forced nonlinear oscillators.