A unified framework for multivariate two-sample and k-sample kernel-based quadratic distance goodness-of-fit tests

📅 2024-07-23
📈 Citations: 1
✨ Influential: 0
📄 PDF
🤖 AI Summary
This paper addresses the multivariate two-sample and $k$-sample goodness-of-fit testing problem by introducing the first unified kernelized quadratic distance (KQD) framework. Methodologically, it integrates both two-sample and $k$-sample tests within a single statistical model grounded in matrix-valued distances and reproducing kernel Hilbert space (RKHS) theory; derives the asymptotic null distribution of the test statistic rigorously; and enables finite-sample inference via Monte Carlo or permutation procedures. Key contributions include: (i) establishing the first theoretical equivalence between KQD-based tests and maximum mean discrepancy (MMD) tests; (ii) proposing a scalable, statistically rigorous paradigm for multi-group testing; and (iii) releasing QuadratiK, an open-source software package supporting both R and Python. Extensive simulations and real-data analyses demonstrate that the method maintains accurate Type-I error control while achieving substantial gains in statistical power.

Technology Category

Machine Learning: Kernel MethodsData Mining & Knowledge Management: Anomaly/Outlier DetectionConstraint Satisfaction and Optimization: Distributed CSP/Optimization

Application Category

Graph Algorithms and Modeling for the Web: Algorithms and analysis for heterogeneous, signed, attributed, multi-relational, temporal, higher-order, and annotated Web-related graphsSearch and Retrieval-Augmented AI: Web evaluation methodologies and metricsWeb Mining and Content Analysis: Robustness and generalizability of Web mining methods
📝 Abstract
In the statistical literature, as well as in artificial intelligence and machine learning, measures of discrepancy between two probability distributions are largely used to develop measures of goodness-of-fit. We concentrate on quadratic distances, which depend on a non-negative definite kernel. We propose a unified framework for the study of two-sample and k-sample goodness of fit tests based on the concept of matrix distance. We provide a succinct review of the goodness of fit literature related to the use of distance measures, and specifically to quadratic distances. We show that the quadratic distance kernel-based two-sample test has the same functional form with the maximum mean discrepancy test. We develop tests for the $k$-sample scenario, where the two-sample problem is a special case. We derive their asymptotic distribution under the null hypothesis and discuss computational aspects of the test procedures. We assess their performance, in terms of level and power, via extensive simulations and a real data example. The proposed framework is implemented in the QuadratiK package, available in both R and Python environments.
Problem

Research questions and friction points this paper is trying to address.

Developing unified kernel-based goodness-of-fit tests
Extending two-sample tests to k-sample scenarios
Implementing framework in R and Python packages
Innovation

Methods, ideas, or system contributions that make the work stand out.

Unified kernel-based framework for goodness-of-fit tests
Matrix distance approach for k-sample comparisons
Quadratic distance implementation in R/Python package
University at Buffalo | University of Padua
M
M. Markatou
Department of Biostatistics, University at Buffalo, Kimball Tower, Buffalo, NY, 14214, USA
G
Giovanni Saraceno
Dept. of Statistical Sciences, University of Padua