Problem
Research questions and friction points this paper is trying to address.
neuromorphic encoding
spiking neural networks
energy efficiency
audio processing
hardware implementation
Conjoint Audio-to-Spikes Encoding and Processing for Efficient Neuromorphic Speech Recognition
🤖 AI Summary
本文通过使用非学习型高阶可编程编码器将音频转化为尖峰信号，并在FPGA上实现，优化了编码器和分类器以提高效率并降低能耗。
📝 Abstract
Obtaining data from neuromorphic sensors and processing it with Spiking Neural Networks is a promising solution to lower the energy cost of artificial intelligence. The current rarity of natively neuromorphic datasets promotes the development of software tools to translate input sensory data into spikes. However, highly bio-mimetic simulators can be challenging to implement on digital hardware. In this work, we evaluate the neuromorphic encoding and subsequent classification of audio into spikes using a non-learnable, high-level, programmable encoder targeting hardware implementation on FPGA. We quantify the pipeline's efficiency with hardware-agnostic metrics based on the quantitative spiking activity. Our study focuses on the simultaneous optimisation of encoder and classifier: the first provides efficient and informative data so that the latter achieves a better performance with an overall lower energy cost at learning and inference. This work introduces the first end-to-end neuromorphic spike-encoding and evaluation of the TIMIT dataset. Our simple feedforward network reaches a classification accuracy of 99.77% on a spike-encoded Heidelberg Digits, overcoming the neuromorphic state of the art on this benchmark dataset.
Innovation
Methods, ideas, or system contributions that make the work stand out.
neuromorphic encoding
spiking neural networks
FPGA implementation
end-to-end processing
energy efficiency
🔎 Similar Papers
No similar papers found.
