🤖 AI Summary
This study addresses the challenge of preserving the full conditional distribution of predictors given a response variable in dimension reduction. To this end, it proposes a likelihood-based sufficient dimension reduction (SDR) framework that introduces conditional normalizing flows to the SDR literature for the first time. The method jointly learns a linear projection and a flexible conditional density by maximizing the conditional log-likelihood, employing monotonic rational quadratic spline flows to model complex conditional distributions. The approach is grounded in an interpretable mutual information objective and complemented by a neural Gaussian SDR variant as an auxiliary model. Theoretical analysis establishes Fisher consistency, and empirical evaluations across diverse simulation settings and the UTKFace age prediction task demonstrate accurate recovery of the central subspace, significantly outperforming existing SDR methods and neural Gaussian baselines.
📝 Abstract
Sufficient dimension reduction (SDR) seeks a low-dimensional linear projection of predictors that preserves the conditional distribution of the response. Existing methods target this conditional distribution indirectly, via inverse moments, local forward regression, or neural ensemble regression. We propose FlowSDR, a likelihood-based framework that jointly learns the projection and the conditional density by maximizing a conditional log-likelihood, with the density parameterized by monotone rational-quadratic spline flows. The estimator is Fisher consistent under the SDR model, and its sample objective admits a population interpretation in terms of mutual information. As a complementary model within the same likelihood framework, we introduce the neural Gaussian SDR, a heteroscedastic conditional Gaussian model whose mean and variance are parameterized by shared neural-network functions of the projected predictors. In simulations spanning Gaussian errors, heavy-tailed distributions, two-component mixtures, and settings with tail behavior not captured by mean-variance structure, FlowSDR recovers the central subspace more accurately than existing SDR methods and the neural Gaussian SDR baseline. We further validate these advantages on a face-age prediction task using the UTKFace dataset.