From Unsupervised Subgroups to Hypothetical State-Intervention Policies: An Evaluation of Selected Subgrouping Methods in Observational Health Data

๐Ÿ“… 2026-07-29
๐Ÿ“ˆ Citations: 0
โœจ Influential: 0
๐Ÿ“„ PDF
๐Ÿค– AI Summary
Traditional subgroup analyses in observational biomedical data often yield unstable and difficult-to-interpret results due to individuals experiencing only a single exposure, non-identifiable true causal effects, and uncertain confounding structures. This work proposes an integrated framework that first selects covariates via causal discovery, then constructs exposure- and outcome-agnostic pretreatment subgroups using unsupervised clustering methodsโ€”including K-means, fuzzy C-means, and Bayesian Gaussian mixture models. Subsequently, it evaluates hypothetical intervention strategies through uncertainty-aware screening combined with doubly robust estimation. The approach uniquely unifies unsupervised subgroup discovery with policy evaluation and introduces empirical Bernstein gating and Bayesian pooling to control risk. Applied to PIMA and NHANES datasets, the optimal policies achieved utilities of 0.735โ€“0.799, though risk differences became nonsignificant after multiple testing correction.
๐Ÿ“ Abstract
Conventional subgroup analyses can yield unstable and difficult-to-interpret conclusions, especially in observational biomedical data where each individual is observed under only one exposure state, true individual treatment effects are unavailable, and causal structure is uncertain. We investigate whether subgroups constructed from pretreatment characteristics, without using exposure, outcome, or estimated treatment-effect information, can serve as interpretable units for budget-constrained policy prioritization. We propose a framework combining causal-discovery-informed covariate selection, discovery-evaluation sample splitting, inductive unsupervised clustering, uncertainty-aware subgroup selection, and held-out doubly robust policy evaluation. We compare K-means, hard, membership-weighted, and stochastic Fuzzy C-means, Bayesian Gaussian mixture models, and a supervised causal-forest-derived CATE-tree comparator. Policies are evaluated under a 70% budget for hypothetical obesity-to-non-obesity and elevated-to-lower-glucose state shifts in the PIMA Indians Diabetes dataset and for a lifetime-smoking-history contrast in NHANES. The highest estimated ungated utilities were 0.799 for the BMI policy using Bayesian GMM, 0.735 for the glucose policy using hard or membership-weighted FCM, and 0.775 for the smoking-history policy using K-means. All paired 95% confidence intervals for policy-risk differences included zero, and no comparison remained statistically significant after Holm adjustment. Bayesian pooling generally preserved ungated allocations, whereas Empirical Bernstein gating was more conservative. Policies with similar estimated utility could nevertheless prioritize different individuals. The findings should be interpreted as assumption-dependent decision-support evidence for hypothetical state contrasts rather than proof of intervention benefit.
Problem

Research questions and friction points this paper is trying to address.

subgroup analysis
observational data
policy prioritization
causal inference
unsupervised clustering
Innovation

Methods, ideas, or system contributions that make the work stand out.

unsupervised subgrouping
causal discovery
doubly robust policy evaluation
sample splitting
Bayesian Gaussian mixture models
๐Ÿ”Ž Similar Papers
V
Vasundhara Acharya
Rensselaer Polytechnic Institute, Troy, USA
B
Bulent Yener
Rensselaer Polytechnic Institute, Troy, USA