🤖 AI Summary
This study addresses the conceptual ambiguity surrounding the term “agent harness,” which currently lacks a unified and operational definition, leading to inconsistent usage in both research and practice. Through conceptual analysis, terminological lineage reconstruction, engineering documentation review, and empirical case validation, this work proposes the first necessary and sufficient constitutive definition of an agent harness. Building on this definition, the authors establish inclusion and exclusion criteria that enable consistent classification across six real-world systems and boundary cases. The resulting framework effectively clarifies the conceptual boundaries of agent harnesses, thereby establishing a shared terminological foundation essential for rigorous engineering practice and meaningful academic comparison in intelligent agent systems.
📝 Abstract
The term agent harness now circulates widely in software engineering with generative artificial intelligence. It names the layer that wraps a language model and turns it into a coding agent able to act on a repository. The usage is loose and polysemous. Sometimes the term denotes the whole product (Claude Code, Codex CLI); sometimes it denotes the evaluation scaffold that runs an agent against tasks (the SWE-bench harness); sometimes it gets conflated with an agent framework, an SDK, an IDE plugin, or an orchestrator. What is missing is a reference definition that works as an instrument, one that includes and excludes cases consistently. We build that definition through a conceptual analysis that combines works with persistent identifiers and primary grey-literature sources, such as official documentation, glossaries, and engineering reports. We reconstruct the genealogy of the term, from the horse's tack to the classic test harness, to the machine-learning evaluation harness, and finally to the agent harness. We then propose a constitutive definition that states the necessary and sufficient conditions for a system to be an agent harness, we operationalize it as an inclusion and exclusion test, and we draw the boundary of the concept against an agent framework, an agent SDK, an IDE plugin, an eval harness, and an orchestrator. We apply the definition to six real harnesses (Claude Code, Codex CLI, Aider, Cline, OpenHands, and SWE-agent) and to deliberate edge cases; the test includes and excludes consistently. We close with a research agenda organized by design tension axes. The contribution is an operational definition of agent harness, with a shared vocabulary, able to guide engineering practice and the scientific comparison of agentic systems.