Angular Regularization for Positive-Unlabeled Learning on the Hypersphere

📅 2025-12-07
📈 Citations: 0
Influential: 0
📄 PDF

career value

197K/year
🤖 AI Summary
This paper addresses the positive-unlabeled (PU) learning problem by proposing AngularPU, a novel PU learning framework grounded in hyperspherical geometry. Instead of explicitly modeling negative examples, AngularPU defines the positive class via learnable prototype vectors and performs classification using cosine similarity and angular margins. It further introduces angular regularization to encourage uniform dispersion of unlabeled samples on the unit hypersphere, thereby enhancing inter-class separability. Theoretically, AngularPU is proven to achieve Bayes-optimality and prototype consistency under mild assumptions. Empirically, AngularPU outperforms or matches state-of-the-art methods across multiple benchmark datasets—particularly excelling in settings with sparse positive examples and high-dimensional embeddings. The framework offers strong geometric interpretability, robust generalization, and favorable scalability, making it both principled and practical for real-world PU learning tasks.

Technology Category

Application Category

📝 Abstract
Positive-Unlabeled (PU) learning addresses classification problems where only a subset of positive examples is labeled and the remaining data is unlabeled, making explicit negative supervision unavailable. Existing PU methods often rely on negative-risk estimation or pseudo-labeling, which either require strong distributional assumptions or can collapse in high-dimensional settings. We propose AngularPU, a novel PU framework that operates on the unit hypersphere using cosine similarity and angular margin. In our formulation, the positive class is represented by a learnable prototype vector, and classification reduces to thresholding the cosine similarity between an embedding and this prototype-eliminating the need for explicit negative modeling. To counteract the tendency of unlabeled embeddings to cluster near the positive prototype, we introduce an angular regularizer that encourages dispersion of the unlabeled set over the hypersphere, improving separation. We provide theoretical guarantees on the Bayes-optimality of the angular decision rule, consistency of the learned prototype, and the effect of the regularizer on the unlabeled distribution. Experiments on benchmark datasets demonstrate that AngularPU achieves competitive or superior performance compared to state-of-the-art PU methods, particularly in settings with scarce positives and high-dimensional embeddings, while offering geometric interpretability and scalability.
Problem

Research questions and friction points this paper is trying to address.

Addresses classification with only positive labels available
Proposes angular regularization to separate unlabeled data on hypersphere
Eliminates need for explicit negative modeling using prototype vector
Innovation

Methods, ideas, or system contributions that make the work stand out.

Uses cosine similarity and angular margin on hypersphere
Employs learnable prototype vector for positive class
Introduces angular regularizer to disperse unlabeled embeddings
🔎 Similar Papers
No similar papers found.