shapley value computation

Methods for computing and estimating Shapley-value attributions and their continuous analogues efficiently and robustly (including decompositions and high-dimensional estimators) to produce order-independent feature or component attributions.

shapleyvaluecomputation

12-Month Skill Trend

Momentum and market value over time
Trending
Score
+20 in 12 mo
96
12 mo agoNow
Career
Value
+$12K in 12 mo
$42K/year
12 mo agoNow

Recommended Survey Paper

Quick overview of the field
View more

Must-Read Papers

Most classic and influential ideas
View more

Computing Exact Shapley Values in Polynomial Time for Product-Kernel Methods

May 22, 2025
MM
Majid Mohammadi
🏛️ CISPA Helmholtz Center for Information Security | Vrije Universiteit Amsterdam | Nanyang Technological University

Kernel methods suffer from poor interpretability, and exact Shapley value computation is typically intractable due to exponential time complexity. Method: This paper proposes PKeX-Shapley, the first algorithm enabling exact polynomial-time Shapley value computation under product kernel models. Its core innovation lies in exploiting the multiplicative structure of product kernels to derive a decomposable functional representation and a recursive Shapley value formula, integrating RKHS theory, functional space decomposition, and dynamic programming for efficiency. Contribution/Results: PKeX-Shapley reduces Shapley value computation complexity from exponential to polynomial time, achieving zero-approximation-error attribution in kernel regression and classification. Moreover, it generalizes to statistical discrepancy measures—including MMD and HSIC—enabling rigorous feature-level interpretability analysis while preserving theoretical fidelity to the underlying kernel model.

Current Shapley approximations lack efficiency for product-kernel structuresExact Shapley value computation is intractable for kernel methodsInterpretability challenges limit kernel methods in high-stakes applications

Exact Shapley value computation requires exponentially many model evaluations, while existing stochastic estimation methods—such as KernelSHAP—lack non-asymptotic theoretical guarantees. This paper proposes a unified stochastic estimation framework for Shapley values. First, it establishes the first rigorous non-asymptotic error bound for KernelSHAP. Second, it unifies both with- and without-replacement sampling strategies within a single probabilistic model, explicitly characterizing the bias–variance trade-off across estimators. Third, integrating tools from probability sampling theory, combinatorial inference, and non-asymptotic concentration inequalities, it designs a decision-tree-specific implementation with sparse computational optimizations. Experiments demonstrate that our method achieves significantly lower mean squared error than baseline estimators on medium- and small-scale datasets, requiring fewer samples. On MNIST and CIFAR-10, it substantially outperforms the open-source KernelSHAP library in attribution accuracy and efficiency.

Efficiently estimating Shapley values for ML model explanationsProviding theoretical guarantees for KernelSHAP and related estimatorsScaling Shapley value estimation to high-dimensional datasets

Exact computation of Shapley values is generally infeasible in machine learning, and existing efficient approximation methods often lack theoretical guarantees—particularly, the mechanism underlying the effectiveness of paired sampling remains unclear. This work proposes OddSHAP, which for the first time reveals that paired sampling achieves accurate estimation by orthogonalizing the even component while preserving the odd component of the set function. Building on the key insight that Shapley values depend solely on the odd part of the set function, OddSHAP constructs a consistent estimator operating exclusively within the odd subspace. The method leverages Fourier bases to isolate this subspace and integrates a surrogate model to identify critical high-order interactions, thereby circumventing combinatorial explosion. Empirical evaluations across multiple benchmarks demonstrate that OddSHAP achieves state-of-the-art estimation accuracy.

approximationattributionestimation error

Improving the Weighting Strategy in KernelSHAP

Oct 07, 2024
LH
Lars Henry Berge Olsen
🏛️ University of Oslo | Norwegian Computing Center

To address the high variance and low computational efficiency of Shapley value approximations in KernelSHAP, this paper proposes a deterministic kernel weighting scheme that replaces conventional stochastic weighting. Grounded in Shapley value theory and weighted least squares regression, the method analytically derives a deterministic weight function, substantially reducing estimation variance. Furthermore, the implementation of KernelSHAP in the SHAP library is optimized to enhance computational simplicity and robustness while preserving theoretical consistency. Experiments demonstrate that, without compromising explanation fidelity, the approach reduces the number of contribution function evaluations by 5%–50% and accelerates inference by up to 50%, enabling real-time, interpretable analysis for high-dimensional features and large-scale predictions. The core innovation lies in the first principled replacement of stochastic kernel weights with a theory-driven deterministic weighting mechanism—achieving improved efficiency, numerical stability, and scalability.

Enhancing accuracy in explainable AI predictionsImproving computational efficiency of KernelSHAPReducing variance in Shapley value approximations

RankSHAP: Shapley Value Based Feature Attributions for Learning to Rank

May 03, 2024
TC
Tanya Chowdhury
🏛️ University of Massachusetts Amherst

Existing feature attribution methods for learning-to-rank (LTR) lack ranking-aware theoretical foundations, often yielding contradictory or counterintuitive results that undermine interpretability. Method: This paper introduces the first game-theoretic, axiomatized framework for ranking—formally specifying ranking-specific axioms including ranking consistency and efficiency—and derives Rank-SHAP, the first axiomatic extension of Shapley values to ranking tasks. Contribution/Results: We evaluate Rank-SHAP on MSLR-WEB30K and Istella with state-of-the-art LTR models (e.g., LambdaMART, DeepRank) and validate it via user studies. Results demonstrate significant improvements in attribution consistency and alignment with human judgment. Axiomatic analysis further reveals that most existing attribution methods violate fundamental ranking axioms. This work establishes the first rigorous, axiom-based foundation for explainable LTR.

Addresses inconsistencies in feature attributions for ranking modelsEnsures feature attribution methods satisfy fundamental axiomsIntroduces RankSHAP for ranking based on Shapley values

Latest Papers

What's happening recently
View more

This work addresses the computational intractability of standard SHAP due to its #P-hard complexity in feature attribution by integrating causal knowledge into the interpretability framework. The authors propose Asymmetric Shapley Values (ASV) grounded in causal graphs, leveraging equivalence classes derived from topological orderings of the causal structure. They establish, for the first time, a polynomial-time exact algorithm for computing ASV under rooted directed tree structures and further develop an efficient approximation algorithm applicable to arbitrary causal directed acyclic graphs (DAGs). Experimental results demonstrate that the proposed approach substantially improves computational efficiency on real-world causal structures while preserving high-quality explanation fidelity.

Asymmetric Shapley Valuescausal graphcomputational complexity

This work addresses the lack of theoretical foundations for feature attribution in multi-output predictive models, particularly the unresolved question of whether Shapley values should be computed independently for each output. By extending classical cooperative game axioms—efficiency, symmetry, dummy player, and additivity—to the vector-valued setting, the paper establishes a rigidity theorem: any attribution rule satisfying these axioms must decompose as a component-wise sum across individual outputs. This result formally justifies the necessity of output-wise SHAP explanations. Empirical validation on biomedical benchmarks demonstrates that this component-wise approach not only preserves interpretability consistency but also substantially improves computational efficiency during both training and deployment of multi-output models.

fairnessfeature attributioninterpretability

This work addresses the high computational complexity and poor scalability of SHAP in high-dimensional settings by proposing XAI–TU, a novel cooperative game-theoretic framework that integrates equal surplus and proportional allocation principles. Within this framework, the authors design ESENSC_rev2, a low-complexity feature attribution rule that satisfies the null player property and other key interpretability axioms. ESENSC_rev2 is the first SHAP alternative to offer both a polynomial-time closed-form solution and a rigorous axiomatic foundation. Experimental results across multiple tabular datasets demonstrate that ESENSC_rev2 efficiently approximates exact SHAP values with high accuracy, achieving a favorable balance between computational efficiency and theoretical guarantees while significantly improving scalability in high-dimensional scenarios.

axiomatic methodcomputational efficiencyexplainable AI

This work addresses the challenge of efficiently estimating Shapley values in settings where coalition evaluations are computationally expensive and severely budget-constrained. It introduces, for the first time, Bayesian experimental design to this problem by proposing an adaptive sampling method that leverages a Gaussian process surrogate model. The approach strategically selects the most informative coalitions for evaluation by maximizing expected information gain. By exploiting the linearity of Shapley values and properties of elementary symmetric polynomials, the method reduces the computational complexity from exponential to polynomial in the number of players. Empirical results demonstrate that under tight evaluation budgets, the proposed algorithm substantially outperforms existing baselines across multiple high-cost application scenarios, achieving markedly higher sample efficiency.

Bayesian experimental designcostly evaluationssample efficiency

Traditional Shapley value computation is computationally prohibitive, and existing learnable explanation methods struggle with the non-uniform grids and irregular geometries commonly encountered in physical simulations. This work proposes OperatorSHAP—the first mesh-agnostic attribution method that extends Shapley values to function spaces. By integrating neural operator architectures with a learnable explainer, OperatorSHAP delivers consistent explanations across varying mesh resolutions without requiring model retraining. The method establishes a theoretical connection to the Aumann–Shapley value and demonstrates strong empirical alignment with discrete Shapley values across multiple grid resolutions. Consequently, it significantly enhances both the efficiency and generalization of model interpretability in physics-informed applications.

attribution methodsirregular gridsmodel interpretability

Hot Scholars

FF

Fabian Fumagalli

Phd Candidate - Bielefeld University
Machine LearningExplainable AI
JP

Jian Pei

Arthur S. Pearse Distinguished Professor, Duke University
Data miningbig data analyticsdatabase systemsinformation retrieval
BK

Bryan Kian Hsiang Low

Associate Professor (with tenure), Department of Computer Science, National University of Singapore
Bayesian OptimizationGaussian ProcessesFederated LearningData-centric AI
WT

Weijing Tang

Carnegie Mellon University
Network AnalysisSurvival AnalysisMachine Learning
CM

Christopher Musco

Associate Professor, New York University
AlgorithmsTheory of ComputationMachine Learning