Source-Free Domain Adaptation by Optimizing Batch-Wise Cosine Similarity

📅 2026-01-24
📈 Citations: 0
✨ Influential: 0
📄 PDF
🤖 AI Summary
This work proposes a source-free unsupervised domain adaptation method that operates without access to source domain data. By optimizing the intra-batch cosine similarity and dissimilarity of target-domain samples and incorporating a neighborhood signature–based clustering mechanism, the approach effectively suppresses interference from noisy neighbors and constructs more discriminative cluster structures. Notably, the method relies solely on a single loss term, substantially simplifying the adaptation process. Extensive experiments on benchmark datasets—including VisDA—demonstrate its state-of-the-art performance, with particularly significant gains on VisDA that underscore both its effectiveness and novelty.

Technology Category

Machine Learning: Transfer, Domain Adaptation, Multi-Task LearningComputer Vision: Adversarial Attacks & RobustnessApplication Domains: Humanities & Computational Social Science

Application Category

Search and Retrieval-Augmented AI: Vertical and domain-specific searchGraph Algorithms and Modeling for the Web: Representation, reconstruction, and subgraph or motif discovery in Web-related graphsWeb Mining and Content Analysis: Normalization, clustering, classification, and summarization of Web text
📝 Abstract
Source-Free Domain Adaptation (SFDA) is an emerging area of research that aims to adapt a model trained on a labeled source domain to an unlabeled target domain without accessing the source data. Most of the successful methods in this area rely on the concept of neighborhood consistency but are prone to errors due to misleading neighborhood information. In this paper, we explore this approach from the point of view of learning more informative clusters and mitigating the effect of noisy neighbors using a concept called neighborhood signature, and demonstrate that adaptation can be achieved using just a single loss term tailored to optimize the similarity and dissimilarity of predictions of samples in the target domain. In particular, our proposed method outperforms existing methods in the challenging VisDA dataset while also yielding competitive results on other benchmark datasets.
Problem

Research questions and friction points this paper is trying to address.

Source-Free Domain Adaptation
Unlabeled Target Domain
Neighborhood Consistency
Domain Adaptation
Model Adaptation
Innovation

Methods, ideas, or system contributions that make the work stand out.

Source-Free Domain Adaptation
Batch-wise Cosine Similarity
Neighborhood Signature
Unsupervised Clustering
Target Domain Adaptation
🔎 Similar Papers
No similar papers found.
H
Harsharaj Pathak
Machine Learning and Vision Lab, Indian Institute of Technology Hyderabad
V
Vineeth N. Balasubramanian
Department of Computer Science and Engineering, Indian Institute of Technology Hyderabad