A Machine Learning Framework for Uncertainty-Calibrated Capability Decision under Finite Samples

๐Ÿ“… 2026-04-14
๐Ÿ“ˆ Citations: 0
โœจ Influential: 0
๐Ÿ“„ PDF
๐Ÿค– AI Summary
This study addresses the limitations of traditional process capability indices, such as Cpk, which rely on deterministic thresholds under finite sample sizes and neglect estimation uncertainty, often leading to misclassification in critical regions. To overcome this, the work reframes capability assessment as a decision-risk calibration problem and introduces a hybrid framework that integrates a statistical baseline with data-driven residual learningโ€”marking the first incorporation of uncertainty quantification into process capability evaluation. The approach leverages an interpretable baseline to model prior structural assumptions while employing a residual network to capture deviations due to non-normality, measurement error, and small-sample bias. Decision-risk calibration is achieved through nested Monte Carlo simulation. Experimental results demonstrate that the proposed framework significantly improves calibration accuracy and stability in critical regions, remains robust under leakage-free evaluation, and is readily deployable within existing industrial systems.

Technology Category

Machine Learning: Calibration & Uncertainty QuantificationReasoning under Uncertainty: Other Foundations of Reasoning under UncertaintyIntelligent Robots: State Estimation

Application Category

Search and Retrieval-Augmented AI: Web evaluation methodologies and metricsUser Modeling, Personalization and Recommendation: Metrics for user behavior and evaluating successWeb Mining and Content Analysis: Robustness and generalizability of Web mining methods
๐Ÿ“ Abstract
Process capability indices such as $C_{pk}$ are widely used for manufacturing decisions, yet are typically applied via deterministic thresholding of finite-sample estimates, ignoring uncertainty and leading to unstable outcomes near the capability boundary. This paper reformulates capability approval as a decision-risk calibration problem, quantifying the probability of misclassification under finite-sample variability. We propose an uncertainty-aware hybrid framework that combines a statistically grounded baseline with a data-driven residual learner, where the baseline provides an interpretable approximation of failure risk and the residual captures systematic deviations due to non-normality, measurement effects, and finite-sample uncertainty. A nested Monte Carlo procedure is introduced to approximate oracle decision risk under controlled synthetic settings, enabling direct evaluation of probabilistic calibration. Empirical results show that conventional approaches exhibit substantial miscalibration in near-threshold regimes, while the proposed framework provides a structured and uncertainty-aware representation of decision risk that remains stable under stricter leak-free evaluation. The framework is simple, compatible with existing capability metrics, and readily deployable in industrial analytics systems.
Problem

Research questions and friction points this paper is trying to address.

process capability
uncertainty calibration
finite samples
decision risk
misclassification
Innovation

Methods, ideas, or system contributions that make the work stand out.

uncertainty calibration
process capability
finite-sample decision
hybrid machine learning
Monte Carlo risk estimation
๐Ÿ”Ž Similar Papers
No similar papers found.
๐Ÿ’ผ Related Jobs
No related jobs found.
F
Fei Jiang
Independent researchers, Seattle, WA, USA
L
Lei Yang
Independent researchers, Seattle, WA, USA