Problem
Research questions and friction points this paper is trying to address.
Mathematical Constructions
Superintelligence
Benchmark
Parameterised Construction Families
Quality Scores
The Endless Exam: Mathematical Constructions from Today's Models toward Superintelligence
🤖 AI Summary
本文通过引入包含14个参数化构造族的Endless Exam基准，旨在衡量从当前模型到超级智能在数学上的进展，利用自动验证和评分机制评估不同规模问题下的性能。
📝 Abstract
We introduce the Endless Exam, a benchmark for measuring mathematical progress from today's models toward artificial superintelligence through fourteen parameterised construction families. Each submitted object is checked automatically for validity and assigned a relative quality score against a published frontier or construction baseline, without capping improvements at $1$. The families draw on open mathematical problems for long-term targets and generate new instances at larger parameters, where compact certificates keep large constructions verifiable. Across eight models evaluated on 69 distinct instances, continuous quality scores distinguish performance even though no evaluated system surpasses a published frontier. Size-quality curves show how construction quality changes as problem size increases. We release the generators, verifiers, references, model responses and analysis to support continued measurement before and beyond human frontiers.
Innovation
Methods, ideas, or system contributions that make the work stand out.
Endless Exam
mathematical progress
artificial superintelligence
parameterised construction families
continuous quality scores
🔎 Similar Papers
No similar papers found.
