Evidence, Calibration, and Stability: A Triadic Framework for Hypothesis Testing Under Model Uncertainty

📅 2026-08-27
📈 Citations: 0
✨ Influential: 0
📄 PDF
🤖 AI Summary
论文提出Evidence-Calibration-Stability框架,通过区分证据、校准和稳定性来解决模型不确定性下的假设检验问题。
📝 Abstract
Statistical tests are often asked to do too much. A single reported result is expected to describe what the observed data say, reassure readers about repeated-sampling behavior, and remain convincing when the working model is perturbed. Those tasks are connected, but they are not equivalent. Fisherian inductive inference and Neyman-Pearson decision theory clarify the first two; robust testing, sensitivity analysis, fragility measures, multiverse analysis, and distributional-stability methods speak to the third. I propose Evidence-Calibration-Stability (ECS) as a framework for keeping these roles separate while reporting them together. Evidence is post-data. Calibration belongs to the design or procedure. Stability is the post-data distance from the benchmark analysis to a conclusion-reversing perturbation within a declared model neighborhood. Full ECS support is conjunctive: a strong coordinate cannot rescue a failed one. For finite-dimensional affine perturbations, I derive an exact ellipsoidal stability radius. For smooth nonlinear margins, a uniform quadratic-remainder condition yields a certified lower bound over a declared neighborhood, showing when the affine formula is only a surrogate. I also establish coordinate invariance and a matrix extension for multiple claims, and distinguish confirmatory calibration from descriptive calibration profiles when prespecification is unavailable. Simulations for the one-sample t test and Student's historical sleep data show that the three coordinates can lead to different interpretations. ECS is a formal synthesis, not a claim that evidence, power, or robustness is itself new.
Problem

Research questions and friction points this paper is trying to address.

Statistical Tests
Model Uncertainty
Fisherian Inductive Inference
Neyman-Pearson Decision Theory
Robust Testing
Innovation

Methods, ideas, or system contributions that make the work stand out.

Evidence-Calibration-Stability (ECS)
stability radius
affine perturbations
uniform quadratic-remainder condition
coordinate invariance
🔎 Similar Papers
💼 Related Jobs
No related jobs found.
S
Subir Hait
Department of Counseling, Educational Psychology, and Special Education, Michigan State University