Multivariate Multinomial Logit Model with ANOVA Decomposition for Correlated Categorical Outcomes

2026-08-03

AI Summary

This study addresses the limitation of conventional approaches that ignore the interdependencies among multiple categorical outcomes—such as PTSD, depression, and pain—leading to information loss and reduced predictive performance. To overcome this, the authors propose a multivariate multinomial logit model based on ANOVA decomposition, which explicitly captures the conditional dependence structure among outcomes to reduce the complexity of the high-dimensional parameter space. Efficient estimation and variable selection are achieved through a composite likelihood framework combined with bridge penalization. Computationally, a Minorization-Maximization (MM) algorithm is employed to ensure numerical stability. Simulation studies demonstrate the method’s superior accuracy in both parameter estimation and variable selection, and its practical utility is further validated through application to real-world data from the AURORA cohort.

Abstract

In medical research, patients often have multiple interdependent outcomes, such as posttraumatic stress disorder (PTSD), depression, and pain among trauma survivors. Most existing research uses multinomial regression to analyze these interdependent outcomes separately, which ignores correlations between concurrent conditions. This omission may lead to loss of information and reduced predictive accuracy. Accounting for correlations between multiple categorical outcomes requires a high-dimensional parameter space, making model estimation challenging. In this paper, we propose a multivariate multinomial logit model that captures outcome correlations and uses the ANOVA decomposition of the parameter space to reduce the number of parameters. The ANOVA decomposition enables explicit conditional model formulations, which allow for a computationally much simpler composite likelihood for model estimation. We develop an efficient Minorization-Maximization (MM) algorithm to maximize the composite likelihood, which also incorporates variable selection via a bridge penalty. Simulation studies are conducted to evaluate our method, demonstrating its accuracy in parameter estimation and variable selection. We further illustrate our method using data from the AURORA study.

Problem

• correlated categorical outcomes
• multivariate multinomial model
• high-dimensional parameter space
• outcome correlations
• interdependent outcomes

Innovation

• multivariate multinomial logit
• ANOVA decomposition
• composite likelihood
• Minorization-Maximization algorithm
• bridge penalty