Correction of estimator bias in linear regression with categorical covariates with classification error

📅 2025-07-09
📈 Citations: 0
✨ Influential: 0
📄 PDF
🤖 AI Summary
This paper addresses the bias in linear regression parameter estimation arising from misclassification errors in categorical covariates. We propose an asymptotically bias-corrected estimator that requires neither access to true covariate observations nor data recalculation. The method integrates the least-squares estimator based on noisy covariates, the marginal distribution of the true covariates, and the misclassification transition probability matrix, explicitly modeling and eliminating systematic bias induced by measurement error—particularly improving consistency of the intercept estimate. Theoretical analysis establishes the consistency and asymptotic normality of the corrected estimator. Simulation studies confirm its effectiveness across diverse misclassification structures, significantly reducing parameter bias, enhancing estimation accuracy, and increasing statistical power. The key innovation lies in achieving an analytical correction of classical linear regression estimates using only prior knowledge of the misclassification mechanism—specifically, the conditional misclassification probabilities—without requiring additional data or iterative procedures.

Technology Category

Machine Learning: Calibration & Uncertainty QuantificationIntelligent Robots: State EstimationReasoning under Uncertainty: Graphical Models

Application Category

User Modeling, Personalization and Recommendation: Fairness-aware retrieval and rankingSearch and Retrieval-Augmented AI: Web learning to rank, online learning, and counterfactual learning for rankingGraph Algorithms and Modeling for the Web: Algorithms and analysis for incomplete, noisy, or partially observed Web-related graphs
📝 Abstract
The objective of this work is to propose an asymptotic correction method for the estimators of parameters from regression models with covariates subject to classification errors. A correction was developed based on the least squares estimators from regression with erroneous covariates, the marginal probability of the true covariates, and the conditional probability of the erroneous covariates given the true covariates. In this way, we can correct these estimators without the need to correct the erroneous covariates or observe the true covariates. We performed simulations to quantify the performance of the proposed corrections, identifying, that correcting the intercept is crucial for a significant improvement in estimation.
Problem

Research questions and friction points this paper is trying to address.

Correct bias in linear regression with misclassified categorical covariates
Develop asymptotic correction using least squares and probability terms
Improve estimation by focusing on intercept correction
Innovation

Methods, ideas, or system contributions that make the work stand out.

Asymptotic correction for biased regression estimators
Uses least squares and probability matrices
Corrects intercept without true covariates
🔎 Similar Papers
No similar papers found.
💼 Related Jobs
No related jobs found.
A
Alexandre Garcia Dias
Department of Statistics, University of Campinas, Campinas, Brazil
M
Mariana Rodrigues Motta
Department of Statistics, University of Campinas, Campinas, Brazil
A
Alexandre Hild Aono
Center for Molecular Biology and Genetic Engineering (CBMEG), University of Campinas (UNICAMP), Campinas, Brazil