RepICL: Reusable In-Context Prediction Across Heterogeneous Representation Spaces
This study addresses the need for repeated training of few-shot predictors across heterogeneous representation spaces by proposing RepICL, a meta-trained in-context learner incorporating episodic whitening normalization to achieve a "learn once, reuse many times" prediction paradigm. Furthermore, this work constructs RepShiftBench, the first benchmark demonstrating that a shared few-shot prediction process can generalize to unseen representation spaces, and reveals that episodic whitening serves as a critical inductive bias for performance enhancement. Across twelve benchmark settings, the proposed method consistently outperforms logistic regression and existing baselines, substantially improving few-shot classification accuracy in both cross-dataset and cross-modal scenarios.