Parameters vs. Context: TRACE Fine-Tuning for Robust Retrieval-Augmented Generation
This study addresses the challenge in Retrieval-Augmented Generation (RAG) where conflicts between externally retrieved knowledge and internal parametric knowledge often lead to unreliable responses. To mitigate this issue, this work proposes TRACE, a novel framework that introduces a fine-grained supervision mechanism for knowledge source selection based on multi-agent debate trajectories. Furthermore, it incorporates answer completeness regularization during model fine-tuning. By mining high-quality supervision signals from these debate trajectories and reinforcing the generation of tail segments in answers, the proposed approach significantly enhances the model's robustness against misleading knowledge while effectively alleviating the problem of incomplete responses.