Problem
Research questions and friction points this paper is trying to address.
hyperspherical geometry
ECAPA-TDNN
zero-shot voice conversion
angular concentration
effective dimensionality
Understanding Hyperspherical Geometry of ECAPA-TDNN Embedding and Its Impact on Zero-Shot Voice Conversion
🤖 AI Summary
本文分析了ECAPA-TDNN嵌入的超球面几何特性，并通过两种几何正则化策略提高其均匀性和维度，从而改善零样本语音转换的鲁棒性。
📝 Abstract
Angular-margin speaker encoders are widely used in voice conversion, yet the geometry of their classifier prototypes remains poorly understood. We analyze ECAPA-TDNN classifier prototypes as points on the unit hypersphere and characterize their organization using rotation-invariant angular statistics together with global and local effective dimensionality measures. Our analysis shows that standard training can induce angular concentration and a substantial reduction in effective dimensionality. To address this, we investigate two geometric regularization strategies (hinged Riesz log-energy and effective-dimension maximization) applied to classifier prototypes to encourage more uniform hyperspherical coverage. The resulting prototype sets exhibit higher effective dimensionality and improved isotropy, with configuration-dependent effects on speaker-recognition performance. When the corresponding ECAPA-TDNN models are used as speaker encoders for Fast-VGAN, the regularized systems also exhibit improved robustness in zero-shot voice conversion, particularly for previously unseen speakers.
Innovation
Methods, ideas, or system contributions that make the work stand out.
hyperspherical geometry
geometric regularization
effective dimensionality
zero-shot voice conversion
🔎 Similar Papers
No similar papers found.
