Valid Inference on Functions of Causal Effects in the Absence of Microdata

๐Ÿ“… 2024-09-30
๐Ÿ“ˆ Citations: 0
โœจ Influential: 0
๐Ÿ“„ PDF
๐Ÿค– AI Summary
Economists frequently evaluate policy effectiveness using nonlinear functions of multiple causal effect estimatesโ€”such as the Marginal Value of Public Funds (MVPF)โ€”but often lack access to underlying microdata, relying solely on published point estimates and standard errors. When the correlation structure among these effects is unknown, conventional inference for such nonlinear functions suffers from substantial bias and poor confidence interval coverage. This paper introduces, for the first time, an asymptotically efficient and distribution-free method to construct confidence intervals for multivariate nonlinear functions without requiring microdata. Our approach integrates the delta method, robust variance propagation, sensitivity analysis, and Monte Carlo calibration. Empirically, our 95% nominal confidence intervals achieve stable coverage rates of 94.2โ€“95.8%, markedly outperforming existing two-stage procedures. We provide an open-source software package enabling one-click inference.

Technology Category

Machine Learning: Calibration & Uncertainty QuantificationReasoning under Uncertainty: CausalitySearch and Optimization: Non-convex Optimization

Application Category

Security and Privacy: Data transparency and provenanceWeb Mining and Content Analysis: Robustness and generalizability of Web mining methodsGraph Algorithms and Modeling for the Web: Efficient manipulation of static and dynamic Web-related graphs
๐Ÿ“ Abstract
Economists are often interested in functions of multiple causal effects, a leading example of which is evaluating a policy's cost-effectiveness. The benefits and costs might be captured by multiple causal effects and aggregated into a scalar measure of cost-effectiveness. Oftentimes, the microdata underlying these estimates is inaccessible; only published estimates and their corresponding standard errors are available. We provide a method to conduct inference on non-linear functions of causal effects when the only information available is the point estimates and their standard errors. We apply our method to inference for the Marginal Value of Public Funds (MVPF) of government policies.
Problem

Research questions and friction points this paper is trying to address.

Inferring MVPF with unknown correlation structure
Developing worst-case confidence intervals for causal effects
Assessing robustness using breakdown analyses
Innovation

Methods, ideas, or system contributions that make the work stand out.

Constructs worst-case confidence intervals for inference
Leverages experimental designs to tighten intervals
Assesses robustness using breakdown analyses
๐Ÿ”Ž Similar Papers
No similar papers found.
UC San Diego
V
Vedant Vohra
UC San Diego