How to spot outliers: an Ensemble Anomaly Detection Framework

2026-06-18

AI Summary

Risk valuation systems are susceptible to undetected errors caused by data failures, misconfigurations, or anomalies, potentially leading to significant operational losses. This work proposes EQAF, a hierarchical unsupervised ensemble framework for anomaly detection that uniquely integrates domain-specific deterministic rules with multiple complementary statistical outlier detection methods to enable real-time integrity monitoring of risk computation outputs. EQAF effectively identifies subtle anomalies—such as “frozen values”—that are often missed by conventional purely statistical approaches. Experimental evaluation on four real-world risk datasets demonstrates that EQAF achieves F1 scores between 61% and 79% and improves AUC-ROC by 4–6 percentage points over the best individual baseline method, substantiating its robustness and effectiveness.

Abstract

Errors in risk valuation outputs arising from data-feed failures, model misconfiguration, or system malfunctions can propagate undetected through an investment bank's risk infrastructure and generate material operational losses. Using proprietary daily credit-derivatives data from a major global investment bank covering 183 trades across 129 trading days, we design, implement, and empirically evaluate the Ensemble Quality Assessment Framework (EQAF), a layered unsupervised architecture that combines complementary outlier-detection methods to monitor risk calculation integrity in real time. Using a controlled anomaly-injection protocol with eight operationally realistic scenarios, we show that the calibrated ensemble achieves F1 scores of 61-79%, substantially outperforming the best individual method (6-66%) across four distinct risk-measure datasets. Improvements of 4-6 percentage points in AUC-ROC confirm that this advantage is robust to threshold selection. We further demonstrate that purely statistical detection methods systematically fail to identify stale-value anomalies, a class of frozen-feed errors in which valuation outputs are identical to prior observations and therefore indistinguishable from normal data, and that domain-specific deterministic rules are architecturally indispensable. These findings have direct implications for model risk management under Basel III and the Fundamental Review of the Trading Book (FRTB), where automated and auditable quality controls for internal risk models are increasingly required.

Problem

• outlier detection
• risk valuation
• data quality
• operational risk
• anomaly detection

Innovation

• Ensemble Anomaly Detection
• Stale-value Anomalies
• Unsupervised Architecture
• Risk Model Validation
• Operational Risk Monitoring