You've Got to be Efficient: Ambiguity, Misspecification and Variational Preferences

2026-04-06

AI Summary

This study addresses the joint presence of prior ambiguity and likelihood misspecification by developing a unified robust decision framework. It expands the ambiguity set via Kullback–Leibler divergence radii, recasting optimal decision-making as a minimax problem with an exponentially tilted loss function. The approach cleanly disentangles the effects of ambiguity and misspecification, enabling local asymptotic analysis even under global misspecification, and shows that the resulting optimal decisions coincide with those under correct specification in both estimation and treatment assignment. Theoretical results demonstrate that maximum likelihood estimation dominates simulated method of moments, and that efficient two-step GMM outperforms diagonally weighted GMM—even under severe misspecification—while preserving optimality.

Technology Category

• Reasoning under Uncertainty: Stochastic Optimization
• Search and Optimization: Mixed Discrete/Continuous Search
• Machine Learning: Calibration & Uncertainty Quantification

Application Category

• Web Mining and Content Analysis: Robustness and generalizability of Web mining methods
• Graph Algorithms and Modeling for the Web: Algorithms and analysis for incomplete, noisy, or partially observed Web-related graphs
• Economics, Online Markets and Human Computation: Humans versus LLMs for data annotation and labeling

Abstract

This article introduces a framework for evaluating statistical decisions under both prior ambiguity and likelihood misspecification. We begin with an ambiguity set - a frequentist model that pairs a possibly misspecified likelihood with every possible prior - and uniformly expand it by a Kullback-Leibler radius to accommodate likelihood misspecification. We show that optimal decisions under this framework are equivalent to minimax decisions with an exponentially tilted loss function. Misspecification manifests as an exponential tilting of the loss, while ambiguity corresponds to a search for the least favorable prior. This separation between ambiguity and misspecification enables local asymptotic analysis under global misspecification, achieved by localizing the priors alone. Remarkably, for both estimation and treatment assignment, we show that optimal decisions coincide with those under correct specification, regardless of the degree of misspecification. These results extend to semi-parametric models. As a practical consequence, our findings imply that practitioners should prefer maximum likelihood over the simulated method of moments, and efficient GMM estimators - such as two-step GMM - over diagonally weighted alternatives.

Problem

• ambiguity
• misspecification
• statistical decision
• likelihood
• variational preferences

Innovation

• ambiguity
• misspecification
• exponential tilting
• minimax decision
• efficient GMM