VAE with Hyperspherical Coordinates: Improving Anomaly Detection from Hypervolume-Compressed Latent Space

2026-01-25

AI Summary

This work addresses the degradation of unsupervised and out-of-distribution (OOD) anomaly detection performance in high-dimensional variational autoencoders (VAEs), which arises from the exponential growth of latent space hypervolume and the concentration of latent variables near the equatorial region of the hypersphere. To mitigate this issue, the study introduces hyperspherical coordinates into the modeling of the VAE latent space for the first time, constraining latent vectors to align with specific directions on the hypersphere. This yields a more expressive approximate posterior distribution that effectively alleviates high-dimensional degeneracy. The proposed method demonstrates significantly improved anomaly detection sensitivity across diverse real-world datasets—including Martian terrain and galaxy images—as well as standard benchmarks such as CIFAR-10 and ImageNet subsets, achieving state-of-the-art performance.

Technology Category

• Machine Learning: Deep Generative Models & Autoencoders
• Computer Vision: Representation Learning for Vision
• Data Mining & Knowledge Management: Anomaly/Outlier Detection

Application Category

• Graph Algorithms and Modeling for the Web: Graph embeddings and representation learning for Web-related graphs
• Economics, Online Markets and Human Computation: Data quality aspects of human-annotated datasets
• Search and Retrieval-Augmented AI: Web learning to rank, online learning, and counterfactual learning for ranking

Abstract

Variational autoencoders (VAE) encode data into lower-dimensional latent vectors before decoding those vectors back to data. Once trained, one can hope to detect out-of-distribution (abnormal) latent vectors, but several issues arise when the latent space is high dimensional. This includes an exponential growth of the hypervolume with the dimension, which severely affects the generative capacity of the VAE. In this paper, we draw insights from high dimensional statistics: in these regimes, the latent vectors of a standard VAE are distributed on the `equators'of a hypersphere, challenging the detection of anomalies. We propose to formulate the latent variables of a VAE using hyperspherical coordinates, which allows compressing the latent vectors towards a given direction on the hypersphere, thereby allowing for a more expressive approximate posterior. We show that this improves both the fully unsupervised and OOD anomaly detection ability of the VAE, achieving the best performance on the datasets we considered, outperforming existing methods. For the unsupervised and OOD modalities, respectively, these are: i) detecting unusual landscape from the Mars Rover camera and unusual Galaxies from ground based imagery (complex, real world datasets); ii) standard benchmarks like Cifar10 and subsets of ImageNet as the in-distribution (ID) class.

Problem

• anomaly detection
• variational autoencoder
• hyperspherical coordinates
• out-of-distribution
• latent space

Innovation

• hyperspherical VAE
• anomaly detection
• latent space compression
• out-of-distribution detection
• high-dimensional statistics