Automated Assessment of L2 Speech Rhythm Using Low-Frequency Amplitude Modulations

📅 2026-09-21
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
本文提出了一种基于低频幅度调制的卷积神经网络方法,直接从语音信号中提取节奏特征,以解决非母语者语音评估中对韵律评价的问题。
📝 Abstract
Automated Speaking Assessment of non-native speech must effectively evaluate prosody, including speech rhythm, to align with human perception. However, commonly employed rhythm metrics rely on segmental duration, requiring an additional alignment step, which is error-prone in non-native speech containing disfluencies and mispronunciations. We propose an acoustics-based assessment approach that employs a convolutional neural network to extract rhythm features directly from the speech amplitude envelope, motivated by evidence linking low-frequency modulations to rhythm perception. The proposed models are trained on a proficiency score regression task using the speechocean762 dataset and compared against duration-based models. Our results show that a model using the amplitude envelope's first derivative achieves the highest correlation with human-assigned scores on the Fluency and Prosody dimensions, producing significantly lower errors than one using segment durations among less fluent speakers. The findings support acoustic envelope features as robust, alignment-free alternatives for L2 rhythm assessment. Code is released publicly.
Problem

Research questions and friction points this paper is trying to address.

L2 speech
rhythm assessment
automated speaking assessment
prosody
Innovation

Methods, ideas, or system contributions that make the work stand out.

convolutional neural network
amplitude envelope
low-frequency modulations
alignment-free
🔎 Similar Papers
No similar papers found.
J
João Lima
School of Electrical and Computer Engineering, Universidade Estadual de Campinas
L
Lucas Ueda
School of Electrical and Computer Engineering, Universidade Estadual de Campinas
P
Paula Costa
School of Electrical and Computer Engineering, Universidade Estadual de Campinas