🤖 AI Summary
This study investigates how correlations among biomarkers influence the discriminative performance of predictive models, elucidating the mechanism by which adding new biomarkers does not necessarily improve model accuracy. Through theoretical derivations under multivariate normal and skewed distributions, simulation experiments—including log-folded bivariate normal and Gamma distributions—and validation using serum metabolomic data from pancreatic ductal adenocarcinoma patients, the work establishes, for the first time, an analytical relationship between biomarker correlation structures and the area under the ROC curve (AUC). The findings demonstrate that negative correlation most substantially enhances the joint AUC when individual biomarkers exhibit comparable predictive power, and real-world metabolomic data confirm that inter-biomarker correlation plays a decisive role in the performance of disease detection models.
📝 Abstract
Different methods have been employed to estimate models maximizing the area under the receiver operating characteristic curve (ROC-AUC). Once a model is developed, integrating novel biomarkers may improve its diagnostic ability. However, the discrimination improvement from adding a new biomarker is not always evident, even if the marker itself has good discriminatory power. The sign and magnitude of correlations between biomarkers may impact model performance. In this paper, we assess the effect of such correlations on the discrimination ability of predictive models. Under multivariate normality, we derive an expression for the maximum AUC as a function of the correlations between markers, illustrated graphically using surfaces. Logarithmic folded bivariate normal and Gamma simulations address skewed data cases. Additionally, AUC improvement was assessed combining 1934 blood lipid metabolites determined by liquid chromatography in 44 pancreatic cancer cases and 38 controls from the PanGenMic Study. Our results show that negative correlations consistently maximize the combined AUC, offering the greatest improvements when markers have equal predictive ability, while positive correlations yield the least favorable results. Negative correlations remain optimal for markers with differing abilities, though positive correlations show slight benefits. Simulations with skewed distributions confirm these trends, emphasizing the role of asymmetry in marker selection. Real-world analysis of serum lipid-derived metabolites for detecting pancreatic ductal adenocarcinoma (PDAC) reinforces the influence of correlations on AUC optimization. These findings suggest that the sign and magnitude of inter-biomarker correlations should be considered when incorporating new markers into predictive algorithms.