Problem
Research questions and friction points this paper is trying to address.
software repository
optimization-opportunity discovery
engineering objective
source region
Spotlights: Discovering Improvement Opportunities in Software Repositories
🤖 AI Summary
研究提出Spotlights系统，通过逻辑仓库映射和代理审查等方法，在软件仓库中自动发现优化机会，无需指定具体缺陷或瓶颈。
📝 Abstract
Coding agents and evolutionary code-search systems can improve implementations once a target and evaluation criterion have been specified. Applying these methods to an existing software repository raises an earlier question: which implementation choices are worth investigating for a high-level engineering objective? We introduce \emph{optimization-opportunity discovery}, the repository-level task of identifying candidate source regions, explaining how they relate to the objective, and proposing possible changes. The task takes as input a repository, an engineering objective, and optional runtime evidence such as offline telemetry observations or profiles. It does not require the user to specify a defect, bottleneck, or code location. We present \emph{Spotlights}, a system that performs this task through logical repository mapping, successive agent reviews, and optional research linking candidates to relevant techniques. We evaluate Spotlights across model serving, document retrieval, blockchain ordering, and document processing. Across three cases, it recovers seven of nine expert-selected targets. In the reliability study, 70\% of the top ten candidates meet the stated correctness and severity thresholds. Across five repeated retrieval runs, 73.6\% of candidate occurrences have a matching source region in all five runs. Spotlights also rediscovers the target of a withheld retrieval optimization and connects it to a relevant tiling technique. In an implementation study, a discovered change reduces end-to-end page-processing runtime by 10.6\% while preserving measured output quality. These results establish optimization-opportunity discovery as a distinct and empirically evaluable step between a broad engineering objective and subsequent implementation and validation.
Innovation
Methods, ideas, or system contributions that make the work stand out.
optimization-opportunity discovery
Spotlights
logical repository mapping
successive agent reviews
runtime evidence
🔎 Similar Papers
No similar papers found.
