LoopLens: Supporting Search as Creation in Loop-Based Music Composition

2026-03-09

AI Summary

This study addresses a critical limitation in existing creative support tools, which treat search as mere information retrieval and overlook its role as a creative medium in loop-based music production, such as electronic dance music. To bridge this gap, the authors propose a novel “search-as-creation” paradigm and present LoopLens, a system that leverages multimodal audio visualizations to facilitate creative exploration and collage-style assembly of musical loops. Through a mixed-methods evaluation combining open-ended and goal-directed tasks, findings reveal that expert users rely on multimodal cues to rapidly narrow down relevant material, whereas novices—constrained by limited musical vocabulary—tend to explore more broadly through audition. The work offers a new perspective on vocabulary-agnostic creative discovery and demonstrates the effectiveness of the proposed paradigm in supporting diverse user backgrounds.

Technology Category

• Cognitive Modeling & Cognitive Systems: Computational Creativity
• Machine Learning: Large Multimodal Models (LMMs)
• Search and Optimization: Learning to Search

Application Category

• Search and Retrieval-Augmented AI: Vertical and domain-specific search
• Web Mining and Content Analysis: Mining multimedia, multimodal, multilingual, cross-lingual Web data
• User Modeling, Personalization and Recommendation: ML for personalized search and recommendations

Abstract

Creativity support tools (CSTs) typically frame search as information retrieval, yet in practices like electronic dance music production, search serves as a creative medium for collage-style composition. To address this gap, we present LoopLens, a research probe for loop-based music composition that visualizes audio search results to support creative foraging and assembling. We evaluated LoopLens in a within-subject user study with 16 participants of diverse musical domain expertise, performing both open-ended (divergent) and goal-directed (convergent) tasks. Our results reveal a clear behavioral split: participants with domain expertise leveraged multimodal cues to quickly exploit a narrow set of loops, while those without domain knowledge relied primarily on audio impressions, engaging in broad exploration often constrained by limited musical vocabulary for query formulation. This behavioral dichotomy provides a new lens for understanding the balance between exploration and exploitation in creative search and offers clear design implications for supporting vocabulary-independent discovery in future CSTs.

Problem

• creative search
• loop-based music composition
• creativity support tools
• vocabulary-independent discovery
• exploration-exploitation

Innovation

• creativity support tools
• loop-based composition
• creative search
• audio visualization
• exploration-exploitation