Full-Duplex Speech Models Take the Floor When Asked, Not When Needed

📅 2026-09-16
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
研究探讨全双工语音模型在应答和必要时发言的问题,通过实验发现这些模型在面对错误信息或危险情况时的响应不足,指出需要提高模型对内容的理解。
📝 Abstract
Full-duplex speech models listen and speak at once, promising always-on assistants. Yet they must also decide when they should speak. Human listeners speak when addressed or when the speaker stops, but also self-select to correct a false claim, supply a missing word, or warn of danger. We ask whether full-duplex models do the same. To separate the reason to speak from the opportunity, we construct context-matched English monologues in which only the trigger utterance varies within a topic, define 10 conditions from turn-allocation rules, and compress inter-word pauses to limit opportunities created by silence. Across five model families, being addressed and silence are far more reliable triggers than false facts or hazards. Frame-level text-token probabilities in Moshi and PersonaPlex are lower for false facts than for Neutral when averaged over the first 2\,s after trigger end. Pauses or permission to interrupt do not close this gap either. Given the floor, Moshi and PersonaPlex answer most direct questions, yet the proportion of non-empty false-fact replies that challenge the claim is only .14--.15, and the proportion of hazard replies that warn of danger is .04--.07. This paper thus identifies a gap in both speech initiation and response content. Closing it requires genuine content understanding and intervention decisions grounded in it.
Problem

Research questions and friction points this paper is trying to address.

full-duplex speech models
false facts
hazards
Innovation

Methods, ideas, or system contributions that make the work stand out.

full-duplex speech models
speech initiation
content understanding
response content
🔎 Similar Papers
No similar papers found.
L
Linkai Peng
University of Connecticut
B
Baorian Nuchged
The University of Texas at Austin
K
Kaiqi Fu
X Square Robot
Y
Yuyang Yao
The University of Oxford