Family-wise Error Rate Control with E-values

📅 2025-01-15
📈 Citations: 0
✨ Influential: 0
📄 PDF
🤖 AI Summary
This paper addresses the challenge of controlling the family-wise error rate (FWER) in multiple hypothesis testing under the e-value framework. We propose the first graph-based closed testing procedure grounded in e-values. By extending graphical methods to the e-value domain—integrating directed acyclic graph (DAG) modeling with dynamic programming—we design a polynomial-time closed testing algorithm. Our approach achieves near-linear time complexity for Holm’s procedure and general fallback graphs: worst-case O(m²), and O(m log m) for specific DAGs. Crucially, it operates directly on e-values without conversion to p-values, thereby substantially improving statistical power. The method accommodates arbitrary DAG structures, overcoming both the computational bottlenecks and power limitations inherent in existing e-value-based closed testing procedures.

Technology Category

Machine Learning: Graph-based Machine LearningReasoning under Uncertainty: Graphical ModelsKnowledge Representation and Reasoning: Computational Complexity of Reasoning

Application Category

Graph Algorithms and Modeling for the Web: Efficient manipulation of static and dynamic Web-related graphsWeb Mining and Content Analysis: Robustness and generalizability of Web mining methodsEconomics, Online Markets and Human Computation: Incentives in network design for Web infrastructures and ecosystems
📝 Abstract
The closure principle is a standard tool for achieving family-wise error rate (FWER) control in multiple testing problems. In general, the computational cost for closed testing can be exponential in the number of hypotheses. The celebrated graphical approach of FWER control overcomes the computational hurdle by using weighted Bonferroni local tests on p-values with appropriately chosen weights. In this study, we extend the graphical approach to e-values. With valid e-values -- common in settings of sequential hypothesis testing or universal inference for irregular parametric models -- we can derive strictly more powerful local tests based on weighted averages of e-values. Consequently, this e-value-based closed test is more powerful than the corresponding graphical approach with inverse e-values as p-values. Although the computational shortcuts for the p-value-based graphical approach are not applicable, we develop efficient polynomial-time algorithms using dynamic programming for e-value-based graphical approaches with any directed acyclic graph. For special graphs, such as those used in the Holm's procedure and fallback procedure, we develop tailored algorithms with computation cost linear in the number of hypotheses, up to logarithmic factors.
Problem

Research questions and friction points this paper is trying to address.

Extends graphical FWER control to e-values for more powerful testing
Develops efficient algorithms for e-value-based approaches using dynamic programming
Enhances computational efficiency for special graphs like Holm's procedure
Innovation

Methods, ideas, or system contributions that make the work stand out.

Extends graphical FWER control to e-values
Uses weighted averages for powerful local tests
Develops polynomial-time dynamic programming algorithms
W
Will Hartog
Department of Statistics, Stanford University
L
Lihua Lei
Graduate School of Business and Department of Statistics, Stanford University