Iterative Atom Refinement: A Monotonicity Principle for Dictionary Learning

📅 2026-09-20
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
该论文提出了一种名为迭代原子细化(IAR)的算法,通过重复选择与当前迭代最相关的观测值并更新方向来恢复字典中的单个原子,解决了稀疏表示下的字典学习问题。
📝 Abstract
Dictionary learning seeks to recover an unknown dictionary $A$ from observations ${\bf y}_i = A{\bf x}_i$ with sparse coefficient vectors ${\bf x}_i$. We introduce the \emph{Iterative Atom Refinement} (IAR) algorithm, a simple procedure for recovering individual dictionary atoms. Starting from a random direction, IAR repeatedly selects the observations most strongly correlated with the current iterate and updates the direction by averaging the selected data. Our main contribution is a rigorous convergence theory of IAR. Using high-dimensional probabilistic estimates and a novel monotonicity principle for atom-selection probabilities, we show that a small initial advantage of one atom is amplified until that atom is isolated. Under our model assumptions, IAR identifies a generating atom after only three refinement steps. Numerical experiments support the theory and show that the resulting dynamics accurately capture the behavior observed in dictionary refinement.
Problem

Research questions and friction points this paper is trying to address.

dictionary learning
sparse representation
atom recovery
Innovation

Methods, ideas, or system contributions that make the work stand out.

Iterative Atom Refinement
dictionary learning
monotonicity principle
A
Alexander Christie
Department of Mathematics, Stanford University, Stanford, CA 94305, USA
M
Miguel Moscoso
Department of Mathematics, Universidad Carlos III de Madrid, Leganés, Madrid 28911, Spain
A
Alexei Novikov
Department of Mathematics, Pennsylvania State University, University Park, PA 16802, USA
G
George Papanicolaou
Department of Mathematics, Stanford University, Stanford, CA 94305, USA
C
Chrysoula Tsogka
Department of Applied Mathematics, University of California, Merced, CA 95343, USA