LLM-as-an-Improver: Turning Verification into Better Candidates

๐Ÿ“… 2026-09-16
๐Ÿ“ˆ Citations: 0
โœจ Influential: 0
๐Ÿ“„ PDF
๐Ÿค– AI Summary
ๆœฌๆ–‡ๆๅ‡บไธ€็งๅˆฉ็”จ้ชŒ่ฏๅ้ฆˆๆ”น่ฟ›ๅ€™้€‰้›†็š„ๆ–นๆณ•VRR๏ผŒ้€š่ฟ‡ไฟฎๅคๅ’Œ้‡ๆ–ฐ้€‰ๆ‹ฉๆๅ‡ๅคงๆจกๅž‹ๆ€ง่ƒฝใ€‚
๐Ÿ“ Abstract
Verifier-based selection improves LLM performance by generating multiple candidate solutions and using a verifier to select the most promising one. However, existing methods typically treat verification only as a ranking step and discard its feedback once a fixed candidate pool has been evaluated. In this paper, we ask whether verification can also improve the candidate set itself. To this end, we introduce LLM-as-an-Improver and propose Verify--Repair--Reselect (VRR), which uses verification feedback to generate and reselect improved candidates. VRR retains the initial winner while conditionally generating three complementary alternatives: repaired versions of the winner and runner-up, and a solution based on a new approach. It filters invalid and duplicate candidates using only inference-time information and then reselects the final answer under the original evaluation criteria. Across diverse models and code-generation and reasoning benchmarks, VRR improves over fixed-pool verifier-based selection in many settings and can recover correct solutions even when all candidates in the initial pool are incorrect. These results highlight a broader role for LLMs as improvers: verification feedback can not only select among existing solutions but also construct stronger candidates beyond the initial pool.
Problem

Research questions and friction points this paper is trying to address.

verification
candidate set
feedback
LLM-as-an-Improver
improvement
Innovation

Methods, ideas, or system contributions that make the work stand out.

LLM-as-an-Improver
Verify--Repair--Reselect (VRR)
verification feedback
improved candidates
reselect
๐Ÿ”Ž Similar Papers
No similar papers found.
A
Akiyoshi Tomihari
Fujitsu Limited, Department of Computer Science, The University of Tokyo
Y
Yuma Ichikawa
Fujitsu Limited, RIKEN center for AIP