Augmented Inverse Hybrid Weighting: Robust Inference under Deterministic and Random Distribution Shifts

2026-08-01

AI Summary

This work addresses the challenge of mixed distributional shift, which simultaneously involves systematic bias and random perturbations—a setting where conventional reweighting methods struggle to balance bias correction with uncertainty quantification. The authors propose a novel framework that explicitly disentangles these two sources of shift: systematic bias is corrected via Augmented Inverse Distance Weighting (AIDW) and Augmented Inverse Hybrid Weighting (AIHW), while residual random perturbations are modeled as distributional uncertainty. Robust inference is achieved through variance-optimal data pooling. The method incorporates distributional distance to govern the bias–variance trade-off, offering both asymptotic theoretical guarantees and practical guidance for hyperparameter tuning. Evaluated on three real-world multicenter datasets, the approach substantially reduces mean squared error and improves empirical coverage, demonstrating particular robustness in scenarios where covariate shift correction typically underestimates uncertainty.

Abstract

Reweighting source samples to match a target covariate distribution is a standard response to distribution shift when generalizing evidence from one population to another. This strategy is well suited to deterministic, learnable covariate discrepancies, but can be insufficient when source--target population differences also contain changes beyond covariate shift or when estimation of the density-ratio weights is unstable. To address this challenge, we introduce a new model that allows non-systematic changes between two population laws after systematic shifts are accounted for. Such residual shift is modeled as random perturbations to the probability space that cannot be represented in a learnable way. In this way, we separate systematic shifts, treated as bias and corrected by reweighting, from residual random perturbations, treated as distributional uncertainty and handled through dataset pooling. Under pure random perturbations, this principle yields Augmented Inverse Distance Weighting (AIDW), which uses regression augmentation and variance-optimal dataset-level pooling. For mixed shifts, we develop Augmented Inverse Hybrid Weighting (AIHW), which interpolates between AIDW and standard augmented importance weighting. Both methods trade off sampling uncertainty and distributional uncertainty via a \emph{distributional distance} that describes the strength of random perturbations. We establish asymptotic properties of the methods, together with plug-in guidance for choosing tuning parameters and model diagnostic tools. Experiments on three real-world multi-site datasets demonstrate consistent reductions in mean-squared error compared with standard weighting baselines, along with substantially improved empirical coverage in settings where covariate-shift adjustment alone undercovers, showing the robustness of the proposed methods across diverse distribution shift scenarios.

Problem

• distribution shift
• covariate shift
• random perturbations
• robust inference
• generalization

Innovation

• distribution shift
• reweighting
• random perturbations
• augmented inverse hybrid weighting
• distributional uncertainty