Reusing Statistical Guarantees Under Change: Selection Costs and Event Ownership

2026-10-06

AI Summary

This study addresses the challenges of high selection costs and ambiguous event ownership in the reuse of statistical guarantees within adaptive systems. It proposes the Adaptive Assurance framework, which binds experimental evidence to premise dependencies to enable the safe reuse of guarantees in dynamic environments. The work establishes a multi-switching correction mechanism that derives worst-case expected startup costs while distinguishing conditional recovery from capability adaptation, integrating techniques such as martingale dynamics, compatible outcome projection, and finite counterexample construction. Evaluated across six public domains, the framework demonstrates its effectiveness by explicitly characterizing evidence acquisition and computational overhead, thereby successfully preventing erroneous inheritance and unnecessary resets during guarantee reuse.

Abstract

An adaptive system can retain an earlier estimate while changing what that estimate is used to guarantee. The guarantee depends on the experiment that produced the evidence, including how its target was selected and which assumptions connect it to the current claim. We show that past-measurable selection preserves future martingale dynamics without preserving a unit expected starting value. An exact finite counterexample, using a strictly positive family, refutes a published changing-prior extension as stated with probability one and rules out unrestricted bounds based only on switch count and the error level. We give a paid-start multi-switch correction and establish $m$ as the sharp worst-case expected starting-moment cost for an unstructured family of $m$ hypotheses. We then develop Adaptive Assurance, a framework in which statistical events retain their experiment, funding and outcome bindings while claims and premise dependencies change. Compatible-outcome projection supports reuse, selective invalidation, fresh acquisition and auditable decisions. Two histories can have identical current regions yet require different responses to a later edit, making evidence origin part of the assurance state. Studies in six public-recorded domains exercise heterogeneous outcomes and access contracts. Component interventions expose erroneous inheritance and unnecessary resets. The framework separates conditional guarantee recovery from competence adaptation, with explicit costs for evidence, computation and verification.

Problem

• adaptive systems
• statistical guarantees
• selection cost
• evidence reuse
• martingale dynamics

Innovation

• martingale dynamics
• paid-start multi-switch correction
• Adaptive Assurance
• compatible-outcome projection
• past-measurable selection