Counterfactual Evaluation of Temporal Observation Protocols

📅 2026-08-23
📈 Citations: 0
✨ Influential: 0
📄 PDF
🤖 AI Summary
研究通过已实现的观测协议数据评估未部署协议的预测价值问题,提出了一种基于潜在协方差结构的识别理论来解决此问题。
📝 Abstract
We study counterfactual protocol evaluation: whether data collected under a realised observation protocol determine the predictive value of alternatives that were never deployed. Protocol value is the population $R^2$ of the Bayes-optimal predictor of a fixed trajectory-level target from the measurements an alternative would collect. We show that even infinite benchmark data need not determine this value: distinct latent covariance structures can induce the same benchmark measurement--target law while assigning different values to the same alternative. We develop a value-specific identification theory in which only latent ambiguity that changes the alternative's value matters. For linear targets, invisible covariance directions certify non-identification, while targeted measurements can restore identification without recovering the full latent covariance; an exact permutation construction extends the result to nonlinear aggregate targets. With finite dense calibration data, uniform error bounds control protocol-selection regret and distinguishable value gaps. Exact marginal gains then support cost-constrained, target-aware observation design. Simulations and retrospective analyses of Sleep-EDF and Long-Term AF show that broad temporal-layout differences can be more reliably distinguished than fine placements selected from finite data. Together, these results connect identification, calibration resolution and observation design for undeployed protocols.
Problem

Research questions and friction points this paper is trying to address.

counterfactual protocol evaluation
predictive value
observation protocols
latent covariance
identification theory
Innovation

Methods, ideas, or system contributions that make the work stand out.

counterfactual protocol evaluation
latent covariance structures
value-specific identification theory
targeted measurements
cost-constrained observation design
🔎 Similar Papers
No similar papers found.
💼 Related Jobs
No related jobs found.
X
Xizhe Zhang