Technology Category
Natural Language Processing: GenerationHumans and AI: Human-Aware Planning and Behavior PredictionCognitive Modeling & Cognitive Systems: Computational Creativity
DAWZY: A New Addition to AI powered"Human in the Loop"Music Co-creation
🤖 AI Summary
In existing digital audio workstations (DAWs), high-level creative intents—e.g., “warm vocal tone”—are difficult to map efficiently onto low-level parameter adjustments, while AI-based audio generators typically produce single-shot outputs without iterative or reversible human-AI co-creation capabilities. Method: We propose NLP-DAW, a framework centered on large language models (LLMs) that translates natural language instructions—including speech and humming—into executable code for direct control of REAPER DAW. It introduces the Model Context Protocol (MCP) to enable context-aware real-time state querying, fine-grained parameter adjustment, and AI-driven beat generation, augmented by atomic scripts and built-in undo functionality for safe, reversible operations. Contribution/Results: Featuring a voice-first, minimalist interface, NLP-DAW demonstrates stable performance across common music production tasks. User evaluation confirms significant reductions in learning overhead and substantial improvements in perceived control, usability, and creative fluency—establishing a novel paradigm for human-AI collaborative music creation.
Technology Category
Application Category
📝 Abstract
Digital Audio Workstations (DAWs) offer fine control, but mapping high-level intent (e.g.,"warm the vocals") to low-level edits breaks creative flow. Existing artificial intelligence (AI) music generators are typically one-shot, limiting opportunities for iterative development and human contribution. We present DAWZY, an open-source assistant that turns natural-language (text/voice/hum) requests into reversible actions in REAPER. DAWZY keeps the DAW as the creative hub with a minimal GUI and voice-first interface. DAWZY uses LLM-based code generation as a novel way to significantly reduce the time users spend familiarizing themselves with large interfaces, replacing hundreds of buttons and drop-downs with a chat box. DAWZY also uses three Model Context Protocol tools for live state queries, parameter adjustment, and AI beat generation. It maintains grounding by refreshing state before mutation and ensures safety and reversibility with atomic scripts and undo. In evaluations, DAWZY performed reliably on common production tasks and was rated positively by users across Usability, Control, Learning, Collaboration, and Enjoyment.
Problem
Research questions and friction points this paper is trying to address.
Bridges high-level creative intent to low-level DAW edits
Enables iterative human-AI collaboration in music production
Reduces interface complexity through natural language interaction
Innovation
Methods, ideas, or system contributions that make the work stand out.
Open-source assistant converts natural language to reversible DAW actions
LLM-based code generation replaces complex interfaces with chat interaction
Model Context Protocol tools enable live state queries and parameter adjustments
🔎 Similar Papers
No similar papers found.
