Beyond PCA: Manifold Dimension Estimation via Local Graph Structure

📅 2025-10-16
📈 Citations: 0
✨ Influential: 0
📄 PDF
🤖 AI Summary
This paper addresses the limited accuracy of intrinsic dimension estimation on manifolds caused by neglecting local curvature and geometric structure. To overcome this, we propose a unified framework integrating principal component analysis (PCA) with regression modeling. Methodologically, we introduce two novel estimators—quadratic embedding and total least squares—that explicitly encode local curvature and graph-topological structure, thereby mitigating bias inherent in conventional PCA-based approaches, especially in highly curved regions. Theoretically grounded and empirically validated, our framework exhibits both robustness and interpretability. Experiments on synthetic and real-world datasets demonstrate that it matches or surpasses state-of-the-art methods in estimation accuracy, with particularly pronounced improvements in strongly curved manifold regions.

Technology Category

Machine Learning: Learning with ManifoldsIntelligent Robots: State EstimationComputer Vision: Other Foundations of Computer Vision

Application Category

Graph Algorithms and Modeling for the Web: Graph embeddings and representation learning for Web-related graphsWeb Mining and Content Analysis: Robustness and generalizability of Web mining methodsUser Modeling, Personalization and Recommendation: Fairness-aware retrieval and ranking
📝 Abstract
Local principal component analysis (Local PCA) has proven to be an effective tool for estimating the intrinsic dimension of a manifold. More recently, curvature-adjusted PCA (CA-PCA) has improved upon this approach by explicitly accounting for the curvature of the underlying manifold, rather than assuming local flatness. Building on these insights, we propose a general framework for manifold dimension estimation that captures the manifold's local graph structure by integrating PCA with regression-based techniques. Within this framework, we introduce two representative estimators: quadratic embedding (QE) and total least squares (TLS). Experiments on both synthetic and real-world datasets demonstrate that these methods perform competitively with, and often outperform, state-of-the-art alternatives.
Problem

Research questions and friction points this paper is trying to address.

Estimating intrinsic manifold dimension using local graph structure
Improving PCA by accounting for manifold curvature effects
Developing regression-based dimension estimators that outperform existing methods
Innovation

Methods, ideas, or system contributions that make the work stand out.

Integrates PCA with regression-based local graph structure
Introduces quadratic embedding estimator for manifold dimension
Proposes total least squares estimator outperforming existing methods
💼 Related Jobs
No related jobs found.
Z
Zelong Bi
P
Pierre Lafaye de Micheaux