🤖 AI Summary
Existing explanation methods for multiple instance learning (MIL) models typically produce region-level heatmaps, which fall short in revealing how feature interactions across distinct tissue regions jointly drive predictions. To address this limitation, this work proposes Symb-xMIL—the first framework to integrate symbolic logic rules into post-hoc MIL interpretability—enabling a shift from visual attribution to structured semantic reasoning by quantifying the alignment between model behavior and human-readable logical operators (e.g., AND, OR, NOT). By combining logical relationship modeling, rule-alignment scoring, and post-hoc analysis, Symb-xMIL accurately recovers ground-truth rules on synthetic data, uncovers heterogeneous decision patterns and locates model errors in tumor detection, and significantly improves patient stratification in HPV-related survival prediction, demonstrating strong clinical potential.
📝 Abstract
Explanations of multiple instance learning (MIL) models are widely used for validation and discovery in digital histopathology. Existing methods primarily rely on heatmaps that highlight influential regions but do not explain how evidence from different tissue regions is combined to produce a prediction. This limits interpretability, especially when decisions depend on interactions between tissue features. We introduce Symbolic explainable MIL (Symb-xMIL), a post-hoc explanation framework that quantifies how a MIL model's behavior aligns with human-readable decision rules, expressed as logical relationships (e.g., AND, OR, NOT) between input features. These alignment scores reveal semantic patterns underlying the model's predictions. We evaluate Symb-xMIL on synthetic and real-world histopathology datasets. On synthetic MIL data, Symb-xMIL reliably recovers ground-truth logical rules. In a clinical tumor detection task, the best-aligned rules uncover heterogeneous decision patterns and expose hidden model errors. On an HPV-prediction task on TCGA-HNSCC, a cohort of head and neck cancer, our framework refines patient survival stratification beyond HPV status with potential clinical relevance. Overall, Symb-xMIL extends MIL explainability beyond visual attribution toward structured, rule-based reasoning, enabling more transparent and semantically grounded interpretation of model predictions.