Efficient Estimation of High Information Projections using Nearest Neighbours

📅 2026-08-26
📈 Citations: 0
✨ Influential: 0
📄 PDF
🤖 AI Summary
本文提出了一种基于最近邻关系增强的数据降维方法,通过构建和分解能够捕捉局部协方差结构的矩阵来寻找多变量数据的有趣投影,该方法有效估计了密度信息矩阵。
📝 Abstract
An intuitive method for dimensionality reduction is proposed, which is highly effective for finding interesting projections of multivariate data. Following similar intuitive motivation to a number of existing techniques, the proposed method is based on enhancing the nearest neighbour relationships in the data. The proposed projection arises from the spectral decomposition of a matrix designed to encode the local covariance structure in the data, where the local covariance at a point is captured by pairs of its nearest neighbours. We show that under standard regularity conditions this matrix is a consistent estimator of the so-called ``Density Information Matrix'' (DIM); a non-parametric analogue of the Fisher Information Matrix. Spectral decompositions of DIMs have been shown to be connected with the important problems of Independent Components Analysis and, in the supervised context, Sufficient Dimension Reduction. However, existing estimators of the DIM are computationally expensive to compute and only target the DIM of a surrogate density, which is proportional to the square of the true underlying density. In addition, we go on to explore the practical utility of our method in aiding the downstream tasks of cluster analysis and outlier detection.
Problem

Research questions and friction points this paper is trying to address.

High Information Projections
Density Information Matrix
Nearest Neighbours
Innovation

Methods, ideas, or system contributions that make the work stand out.

nearest neighbours
spectral decomposition
Density Information Matrix (DIM)
dimensionality reduction
💼 Related Jobs
No related jobs found.
D
David P. Hofmeyr
School of Mathematical Sciences, Lancaster University