Music Source Restoration with Ensemble Separation and Targeted Reconstruction

📅 2026-03-13
📈 Citations: 0
✨ Influential: 0
📄 PDF
🤖 AI Summary
This work addresses the challenging task of recovering original, unprocessed stems from fully mixed and mastered music recordings. The proposed approach employs a two-stage pipeline: first, it aggregates outputs from multiple pre-trained source separation models to obtain initial stem estimates; second, it applies a dedicated BSRNN-based restoration model to each estimated stem to reverse complex audio degradations such as equalization, dynamic range compression, and reverberation. By uniquely combining ensemble-based separation with targeted restoration, the method effectively mitigates the compounded distortions present in real-world audio. Evaluated on the official MSR benchmark, the proposed system achieves the second-highest overall score, demonstrating substantial improvement over existing baselines.

Technology Category

Machine Learning: Multimodal LearningSearch and Optimization: Mixed Discrete/Continuous SearchIntelligent Robots: State Estimation

Application Category

Search and Retrieval-Augmented AI: Web learning to rank, online learning, and counterfactual learning for rankingUser Modeling, Personalization and Recommendation: On-Device user modeling, personalization, and recommendationGraph Algorithms and Modeling for the Web: Efficient manipulation of static and dynamic Web-related graphs
📝 Abstract
The Inaugural Music Source Restoration (MSR) Challenge targets the recovery of original, unprocessed stems from fully mixed and mastered music. Unlike conventional music source separation, MSR requires reversing complex production processes such as equalization, compression, reverberation, and other real-world degradations. To address MSR, we propose a two-stage system. First, an ensemble of pre-trained separation models produces preliminary source estimates. Then a set of pre-trained BSRNN-based restoration models performs targeted reconstruction to refine these estimates. On the official MSR benchmark, our system surpasses the baselines on all metrics, ranking second among all submissions. The code is available at https://github.com/xinghour/Music-source-restoration-CUPAudioGroup
Problem

Research questions and friction points this paper is trying to address.

Music Source Restoration
Source Separation
Audio Restoration
Mastered Music
Stem Recovery
Innovation

Methods, ideas, or system contributions that make the work stand out.

Music Source Restoration
Ensemble Separation
Targeted Reconstruction
BSRNN
Source Separation
🔎 Similar Papers
X
Xinlong Deng
College of Artificial Intelligence, China University of Petroleum, Beijing
Y
Yu Xia
College of Artificial Intelligence, China University of Petroleum, Beijing
J
Jie Jiang
College of Artificial Intelligence, China University of Petroleum, Beijing