Sharp Reconstruction Bounds for Autoencoders Using the Same Forward Map

📅 2026-09-17
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
研究自编码器在相同前向映射下的重建问题,通过设定奇数维度和雅可比矩阵奇异值范围,找到最小重建误差,并在实际数据上验证理论预测。
📝 Abstract
We study reconstruction in autoencoders that apply the same forward map before and after setting the observed coordinates to zero. For equal odd input and hidden dimensions $d\geq 3$, among orientation-preserving diffeomorphisms whose Jacobian singular values lie in $[m,M]$, we show that the least uniform reconstruction-derivative error is $\max\{1-M(M-m)/2,0\}$, with affine maps attaining this sharp bound at every prescribed depth. A translated radial rotation can nevertheless reconstruct any prescribed ball exactly with singular values arbitrarily close to one, motivating additional conditions for a finite-data bound. We test this prediction on a 798,452-point terrestrial LiDAR forest scan. At input scale $0.05$, the mean theoretical bound is $0.155$, about $84\%$ of the mean normalized training error $0.185$ across four spatial regions, two depths, and three seeds. At this scale, adding one hidden coordinate reduces the mean reconstruction error below $6\times10^{-6}$.
Problem

Research questions and friction points this paper is trying to address.

autoencoders
reconstruction
diffeomorphisms
Jacobian singular values
Innovation

Methods, ideas, or system contributions that make the work stand out.

autoencoders
reconstruction-derivative error
affine maps
translated radial rotation
LiDAR forest scan
🔎 Similar Papers
No similar papers found.
💼 Related Jobs
No related jobs found.
P
Patricia Medina
New York City College of Technology, CUNY, Brooklyn, NY, USA; The Graduate Center, CUNY, New York, NY, USA.
H
Hy P. G. Lam
Department of Mathematical Sciences, Worcester Polytechnic Institute, Worcester, MA, USA.