Anchor Divergence for Semantic Geometry in Contrastive Learning

2026-10-02

AI Summary

This study addresses the limitation of fixed geometric structures in contrastive learning, which struggle to accommodate context-dependent semantic similarity. To overcome this, we propose anchor divergence, a method that integrates contrastive learning, exponential family theory, and information geometry. By establishing a correspondence between anchor distributions and Bregman geometry, our approach defines a context-aware dynamic semantic geometry over fixed representations. Specifically, it directly controls the geometric structure by modeling anchor distributions, thereby enabling adaptive similarity measurement. Experimental results demonstrate that the proposed method efficiently and accurately characterizes context-dependent semantic similarity, yielding substantial improvements in retrieval performance.

Abstract

This paper concerns how semantic context determines geometry in learned vector representations. Similarity is typically measured using cosine similarity, which provides a single fixed geometry. Semantic similarity, however, is inherently context dependent: two images may be similar because they depict the same object, share a visual style, or are relevant to the same clinical finding. We show that contrastive representations naturally encompass a family of geometries that can be specialized to particular semantic structure. The key idea is to use an interplay between contrastive learning, exponential families, and information geometry to establish a correspondence between probability distributions over "anchors" and Bregman geometries on the representation space. We use this correspondence to define "Anchor Divergences", a method for specifying context-specific semantic geometries on fixed representations. Under this correspondence, modeling the anchor distribution models the geometry itself. Experiments on retrieval show that anchor divergences provide an effective and efficient way to specify context-specific semantic similarity.

Problem

• Contrastive Learning
• Semantic Similarity
• Information Geometry
• Context-dependent
• Representation Learning

Innovation

• Contrastive Learning
• Anchor Divergences
• Information Geometry
• Bregman Geometry
• Semantic Similarity