Analyzing Visual Attention Patterns During Band Rehearsal with Mobile Eye Tracking

2026-06-02

AI Summary

This study investigates how ensemble musicians achieve coordination through visual attention in natural rehearsal settings. Using Pupil Labs Neon mobile eye trackers, the researchers recorded a quartet during rehearsals and applied YOLOv8 for scene annotation, followed by multimodal analysis integrating gaze matrices, transition matrices, temporal scarf plots, and interview data. The findings reveal, for the first time, a “hub-and-spoke” attention topology during rehearsal: the lead performer serves as the central gaze target, receiving 97% of interpersonal fixations from a novice guitarist. Repetitive practice reduces gaze transitions by an average of 65% (up to 82%), indicating dynamic stabilization of attentional focus, whereas pedagogical interruptions induce attentional fragmentation, while uninterrupted performance fosters integration.

Abstract

Visual attention is central to ensemble coordination, yet how musicians allocate gaze during naturalistic rehearsal remains poorly understood. We present a pilot study using mobile eye tracking to examine gaze behaviour in a four-member band across three songs, each practiced twice. Musicians wore Pupil Labs Neon eye trackers, and YOLOv8-assisted scene annotations mapped fixations to ensemble members and objects in view. Analyzing fixation matrices, transition matrices, temporal scarf plots, and dwell-transition correlations, we uncover a hub-and-spoke attention topology: the session leader was the dominant gaze target for all members, while the learning guitarist concentrated up to 97% of interpersonal dwell on this single reference. Between attempts, gaze transitions decreased by up to 65% on average for unfamiliar material (up to 82% for individual participants) as scanning stabilized. Scarf plots reveal how teaching breakdowns fragment attention and uninterrupted runs consolidate it. Post-session participant reflections align with the quantitative patterns, and we discuss implications for gaze-aware tools in ensemble pedagogy.

Problem

• visual attention
• ensemble coordination
• gaze behavior
• band rehearsal
• mobile eye tracking

Innovation

• mobile eye tracking
• visual attention
• ensemble coordination
• YOLOv8 scene annotation
• gaze topology