TICDA: Tabular In-Context Data Attribution
This study addresses the challenge of efficiently quantifying the influence of demonstration examples on predictions during in-context learning with tabular foundation models, where conventional attribution methods encounter significant computational bottlenecks. To this end, this work proposes TICDA, a framework that directly measures the data attribution contribution of demonstrations to prediction outcomes by constructing linear surrogate models and conducting latent space embedding analysis. Notably, this approach requires only a single forward pass, eliminating the need for parameter updates or multiple inference iterations. The proposed TICDA framework achieves low-cost, high-precision data influence quantification while effectively balancing attribution accuracy with inference efficiency. Extensive evaluations demonstrate its superior performance across diverse downstream tasks, including error detection, context selection, and active learning, establishing it as a practical solution for interpretable in-context learning in tabular domains.