🤖 AI Summary
This study addresses the lack of integrated analysis and visualization tools for high-dimensional acoustic features in bird vocalizations. The authors propose the first open-source, end-to-end framework that combines pYIN-based fundamental frequency estimation, MFCC extraction, and PCA dimensionality reduction to construct a unified timbral space, enabling high-quality audio reconstruction via the Griffin-Lim algorithm. Innovatively, the system integrates neural audio synthesis with a dual-view 3D interactive interface built on Three.js, supporting dynamic trajectory comparison and independent playback of original and synthesized vocalizations. Experimental results demonstrate a Mel-spectral correlation coefficient exceeding 0.92 in bird song reconstruction, confirming the framework’s high-fidelity preservation of perceptual acoustic structure.
📝 Abstract
We present SoundPlot, an open-source framework for analyzing avian vocalizations through acoustic feature extraction, dimensionality reduction, and neural audio synthesis. The system transforms audio signals into a multi-dimensional acoustic feature space, enabling real-time visualization of temporal dynamics in 3D using web-based interactive graphics. Our framework implements a complete analysis-synthesis pipeline that extracts spectral features (centroid, bandwidth, contrast), pitch contours via probabilistic YIN (pYIN), and mel-frequency cepstral coefficients (MFCCs), mapping them to a unified timbre space for visualization. Audio reconstruction employs the Griffin-Lim phase estimation algorithm applied to mel spectrograms. The accompanying Three.js-based interface provides dual-viewport visualization comparing original and synthesized audio trajectories with independent playback controls. We demonstrate the framework's capabilities through comprehensive waveform analysis, spectrogram comparisons, and feature space evaluation using Principal Component Analysis (PCA). Quantitative evaluation shows mel spectrogram correlation scores exceeding 0.92, indicating high-fidelity preservation of perceptual acoustic structure. SoundPlot is released under the MIT License to facilitate research in bioacoustics, audio signal processing, and computational ethology.