Can Vision-Language Models Judge Olympic Diving? From Reasoning to Scores in Zero-Shot Action Quality Assessment

📅 2026-09-16
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
本文使用基于回归的框架,结合视觉-语言模型进行零样本动作质量评估,以解决奥运会跳水项目中自动评分的挑战,提高了评分准确性。
📝 Abstract
Automated action quality assessment (AQA) in Olympic sports remains a challenging task due to the complexity of human motion and the subjectivity inherent in expert judging. This work evaluates the capability of open-source Vision-Language Models (VLMs) to perform zero-shot action quality assessment on Olympic diving videos using the AQA-7 benchmark dataset. In this regard, a regression-based framework is pro-posed to leverage both the semantic reasoning and phase-level sub-scores generated by the VLMs, combining TF-IDF vectorization, dimensionality reduction, and ensemble learning to predict final competition scores. Experimental results show that standalone VLMs achieve moderate Spearman correlations below 0.32, while the proposed ensemble regression framework substantially improves performance in the reported evaluation, reaching a Spearman correlation of 0.67 with a four-model configuration. Textual reasoning features con-sistently outperformed raw numerical sub-scores, highlighting the richness of VLM-generated explanations for action quality analysis. These findings suggest that VLMs hold strong potential as assistive tools for explainable and semi-automated sports performance evaluation. The code is publicly available on GitHub https://github.com/hvelesaca/olympic diving judge vlm
Problem

Research questions and friction points this paper is trying to address.

Action Quality Assessment
Olympic Diving
Vision-Language Models
Zero-Shot
Innovation

Methods, ideas, or system contributions that make the work stand out.

Vision-Language Models
Zero-Shot Action Quality Assessment
Ensemble Regression Framework
Spearman Correlation
Textual Reasoning
🔎 Similar Papers
💼 Related Jobs
No related jobs found.
H
Henry O. Velesaca
ESPOL Polytechnic University, Campus Gustavo Galindo, Guayaquil, Ecuador; Software Engineering Department, Research Center for Information and Communication Technologies (CITIC-UGR), University of Granada, 18071, Granada, Spain
D
David Freire-Obregon
SIANI, Universidad de Las Palmas de Gran Canaria, Spain
L
Luigi Miranda
ESPOL Polytechnic University, Campus Gustavo Galindo, Guayaquil, Ecuador
A
Abel Reyes-Angulo
Michigan Technological University, Houghton MI