Generalized Ridge Regression: Applications to Nonorthogonal Linear Regression Models

📅 2025-04-08
📈 Citations: 0
✨ Influential: 0
📄 PDF
🤖 AI Summary
This paper addresses the instability and interpretability degradation of parameter estimates in multivariate linear regression caused by multicollinearity. We propose a systematic mitigation framework based on generalized ridge regression. First, we derive closed-form analytical expressions for key diagnostic metrics—including variance, coefficient of variation, correlation coefficient, variance inflation factor (VIF), and condition number—under generalized ridge regression, thereby establishing a unified theoretical framework for quantifying and regulating multicollinearity in non-orthogonal design matrices. Through rigorous theoretical analysis and two numerical experiments, we demonstrate that the proposed method substantially improves estimation stability and model interpretability consistency. The framework provides an analytically tractable and empirically verifiable statistical tool for modeling high-dimensional collinear data.

Technology Category

Machine Learning: Multi-instance/Multi-view LearningKnowledge Representation and Reasoning: Diagnosis and Abductive ReasoningReasoning under Uncertainty: Graphical Models

Application Category

Web Mining and Content Analysis: Robustness and generalizability of Web mining methodsSearch and Retrieval-Augmented AI: Web evaluation methodologies and metricsUser Modeling, Personalization and Recommendation: Explainable and interpretable methods for personalization
📝 Abstract
This paper analyzes the possibilities of using the generalized ridge regression to mitigate multicollinearity in a multiple linear regression model. For this purpose, we obtain the expressions for the estimated variance, the coefficient of variation, the coefficient of correlation, the variance inflation factor and the condition number. The results obtained are illustrated with two numerical examples.
Problem

Research questions and friction points this paper is trying to address.

Mitigate multicollinearity in linear regression models
Analyze variance and correlation coefficients
Illustrate results with numerical examples
Innovation

Methods, ideas, or system contributions that make the work stand out.

Generalized ridge regression reduces multicollinearity
Expressions derived for variance and correlation metrics
Numerical examples validate the proposed method
R
Rom'an Salmer'on G'omez
Department of Quantitative methods for economics and business, University of Granada, Spain
C
C. G. Garc'ia
Department of Quantitative methods for economics and business, University of Granada, Spain
G
Guillermo Hortal Reina
University of Granada, Spain