Robust regularized covariance matrix estimation: well-posedness and convergent algorithm

📅 2026-03-28
📈 Citations: 0
✨ Influential: 0
📄 PDF
🤖 AI Summary
This study addresses the existence, uniqueness, and algorithmic convergence of covariance matrix estimators in penalized multivariate divergence-based M-estimation under structural constraints. By constructing a regularized M-estimation framework with geodesically convex (not necessarily smooth) penalty functions, the authors rigorously establish the well-posedness of the resulting estimator. They further demonstrate, for the first time, that the standard fixed-point algorithm may fail in this setting and propose a novel reweighted algorithm that integrates tools from geodesic convex analysis and nonsmooth optimization. This new method guarantees monotone convergence for a broad class of penalized M-estimation problems involving structured covariance matrices.

Technology Category

Search and Optimization: Non-convex OptimizationReasoning under Uncertainty: Stochastic OptimizationMachine Learning: Matrix & Tensor Methods

Application Category

Graph Algorithms and Modeling for the Web: Algorithms and analysis for incomplete, noisy, or partially observed Web-related graphsWeb Mining and Content Analysis: Bridging structured and unstructured dataResponsible Web: Human-perceived consequences of algorithmic deployment on the web
📝 Abstract
In this paper, we study properties of penalized and structured M-estimators of multivariate scatter, based on geodesically convex but not necessarily smooth penalty functions. Existence and uniqueness conditions for these penalized and structured estimators are given. However, we show that the standard fixed-point algorithm which is usually applied to an M-estimation problem does not necessarily converge for penalized M-estimation problems. Hence, we develop a new but simple re-weighting algorithm and prove that it has monotone convergence for a broad class of penalized and structured M-estimators of multivariate scatter.
Problem

Research questions and friction points this paper is trying to address.

robust covariance estimation
penalized M-estimation
geodesic convexity
algorithm convergence
structured scatter estimation
Innovation

Methods, ideas, or system contributions that make the work stand out.

penalized M-estimation
geodesic convexity
covariance matrix estimation
re-weighting algorithm
monotone convergence
🔎 Similar Papers
No similar papers found.
💼 Related Jobs
No related jobs found.
M
Mengxi Yi
School of Statistics, Beijing Normal University, Beijing, China
D
David E. Tyler
Department of Statistics, Rutgers University, Piscataway, USA