series expansion methods

Techniques for approximating functions and statistical quantities by expanding them into power, asymptotic, or perturbative series and computing higher-order terms and corrections; used to derive cumulants, asymptotic corrections (e.g., Bartlett corrections), and accurate approximations of probability densities across parameter regimes.

seriesexpansionmethods

12-Month Skill Trend

Momentum and market value over time
Trending
Score
+20 in 12 mo
96
12 mo agoNow
Career
Value
+$12K in 12 mo
$42K/year
12 mo agoNow

Recommended Survey Paper

Quick overview of the field
View more

Must-Read Papers

Most classic and influential ideas
View more

This study addresses the unreliability of conventional asymptotic-based statistical inference in meta-analysis when the number of included studies is small. Focusing on the Gaussian random-effects model, the authors derive—for the first time—a rigorous higher-order Bartlett correction formula tailored to small-sample settings, rectifying an error present in the existing literature. Built upon higher-order asymptotic theory, the proposed correction substantially improves the accuracy of the finite-sample distributional approximation of test statistics. Consequently, it enhances the validity and reliability of hypothesis testing in meta-analytic applications, particularly where sample sizes are limited.

asymptotic methodsBartlett adjustmentGaussian random effects

This study addresses the computational complexity associated with calculating quantiles of the inverse normal distribution, Student’s t-distribution, and outlier rejection criteria in hypothesis testing. To overcome the reliance on table lookups or iterative numerical methods, the paper proposes concise and highly accurate analytical approximations formulated as closed-form expressions. These approximations significantly reduce computational overhead while maintaining precision sufficient for practical statistical applications. The resulting method offers substantial gains in computational efficiency, making it particularly well-suited for resource-constrained environments or scenarios requiring rapid statistical inference. By bridging theoretical rigor with practical utility, the approach delivers both methodological insight and real-world applicability.

computational simplificationhypothesis testingoutlier rejection

This paper identifies the systematic failure of classical statistical methods—including mean-based inference, principal component analysis (PCA), and asymptotic normality assumptions—under heavy-tailed distributions, particularly in medium-sample-size (medium-*n*) real-world settings where they are routinely misapplied. Methodologically, it challenges the uncritical adoption of Gaussian and stable-distribution assumptions and introduces the “Median Law” theoretical framework, which formalizes fundamental limitations under heavy tails: unreliable sample means, distorted empirical distributions, and degenerate principal components. The approach integrates extreme value theory, generalized stable distribution modeling, robust parametric estimation, and pre-asymptotic analysis. Empirical validation draws on counterexamples from finance, economics, and psychology, supplemented by cross-disciplinary case studies. The core contribution is a foundational rethinking of uncertainty quantification and causal inference: it demonstrates that many canonical “cognitive biases” are, in fact, rational inferences under heavy-tailed probability structures—thereby advocating a paradigm shift in statistical practice from idealized asymptotics to empirically grounded probabilistic modeling.

Examining real-world statistical behavior between small and infinite sample sizesIdentifying failures in economic and psychological models from wrong distributionsInvestigating misapplication of statistical techniques to fat-tailed distributions

On learning higher-order cumulants in diffusion models

Oct 28, 2024
GA
Gert Aarts
🏛️ Swansea University | RIKEN | The Chinese University of Hong Kong Shenzhen | Frankfurt Institute for Advanced Studies

Diffusion models are commonly assumed to rely solely on Gaussian priors, raising fundamental questions about whether higher-order cumulants (i.e., n-point correlation functions) beyond Gaussian statistics are erased during the forward process and whether they can be recovered in the reverse process. Method: The authors combine cumulant generating functional analysis, score estimation theory, analytic derivation, and exactly solvable toy models, complemented by numerical validation in scalar lattice field theory. Contribution/Results: For variance-increasing forward processes, the authors provide the first rigorous proof that all higher-order cumulants are conserved; their information is fully encoded in the score function and precisely reconstructed by the reverse sampling process. Crucially, even when the forward process endpoint is approximately Gaussian, higher-order cumulants remain non-vanishing and are accurately recovered—challenging the conventional view that diffusion models fundamentally depend only on Gaussian assumptions. This establishes a theoretical foundation for modeling non-Gaussian structure in diffusion-based generative modeling.

Analyzing diffusion models' learning of non-Gaussian correlationsDemonstrating higher-order cumulant learning in backward processDeriving expressions for cumulant-generating functionals in diffusion

Iterative Methods for Full-Scale Gaussian Process Approximations for Large Spatial Data

May 23, 2024
TG
Tim Gyger
🏛️ Lucerne University of Applied Sciences and Arts | University of Zurich | ETH Zurich

Gaussian processes (GPs) face prohibitive computational complexity and poor scalability when modeling large-scale spatial data. To address this, we propose the Full-Scale Approximation (FSA) framework, which unifies global and local covariance structures within a single coherent model. We introduce a novel adaptive preconditioner that substantially accelerates convergence and enhances robustness of the conjugate gradient method for solving linear systems arising from GP inference. Additionally, we design an efficient prediction variance estimator based on stochastic trace approximation, circumventing costly matrix inversions. Empirical evaluations on both synthetic and real-world datasets demonstrate that FSA achieves accuracy comparable to exact inference via Cholesky decomposition while reducing computation time by orders of magnitude. The core implementation is provided as an open-source C++ library, with Python and R interfaces for broad accessibility.

Accelerating convergence speed for large spatial dataImproving predictive variance calculations with iterative methodsReducing computational costs in Gaussian process approximations

Latest Papers

What's happening recently
View more

This work addresses the lack of a unified and efficient inference framework for models where exact likelihoods are intractable. It proposes the first general modeling and inference framework based on saddlepoint approximation, which preserves access to the moment-generating function through high-level operations to automatically construct the cumulant-generating function, its saddlepoint, and associated gradients. By integrating automatic differentiation, the framework optimizes the saddlepoint likelihood efficiently. It supports flexible modeling with complex distributional compositions and introduces diagnostic metrics that assess approximation error without requiring the true likelihood. Empirical results demonstrate that the method enables accurate parameter estimation, standard error computation, and error diagnosis with high computational efficiency and remarkable flexibility across multiple case studies.

computational statisticslikelihood-based inferencemodel construction

This work addresses the absence of readily available Gaussian quadrature rules for nonclassical weight functions by proposing a general framework that constructs such rules for arbitrary weights via the method of moments and the Stieltjes procedure. Innovatively integrating type-generic programming with adaptive high-precision arithmetic, the approach effectively controls round-off errors and, for the first time, systematically introduces tailored Gaussian quadrature methods to the statistics community. Implemented in Julia as the CustomGaussQuadrature package—accessible from R through JuliaConnectoR—the resulting quadrature rules achieve exact integration of polynomials up to degree \(2n-1\) while substantially reducing the number of function evaluations, thereby offering both high accuracy and computational efficiency.

custom-madeGauss quadraturenumerical integration

Lancaster copulas

Jul 01, 2026

This work proposes a novel class of Lancaster copulas by integrating, for the first time, the orthogonal expansion of continuous Lancaster probabilities with copula theory. By constructing their infinite series representation and associated density expressions, and by systematically analyzing truncation effects, the authors achieve efficient approximations of both the target copula and its density. Theoretical analysis and numerical experiments demonstrate that high-accuracy approximation can be attained using only low-order truncations, offering both rigorous theoretical guarantees and computational tractability. This approach provides a powerful new tool for modeling complex dependence structures in multivariate data.

continuous Lancaster probabilitiescopulajoint distribution

This work addresses the fragmentation in existing Gaussian process–based approaches for approximating solutions to differential equations by proposing a unified Bayesian probabilistic framework. The framework embeds differential equation constraints into the likelihood function through derivative matching, thereby enabling simultaneous estimation of unknown parameters and quantification of uncertainty in the solution. It systematically integrates several established Gaussian process methods for the first time, elucidating their underlying connections. The generality and efficacy of the proposed approach are demonstrated across multiple benchmark problems, establishing a coherent foundation for future theoretical advancements and practical applications in this domain.

differential equationsGaussian processesnumerical methods

This work addresses the challenge of excessive variance in computing N-point correlation functions in lattice quantum chromodynamics by introducing, for the first time, a method that combines normalizing flows with the generating functional of quantum field theory. By modeling derivatives of the source operator within this framework, the authors systematically construct low-variance estimators for correlation functions. The approach is universally applicable to arbitrary bosonic operators and asymptotically approaches the theoretically optimal noise-free estimator. Numerical experiments on glueball correlators and Wilson loops demonstrate variance reductions of up to three orders of magnitude, substantially enhancing both computational efficiency and precision.

correlation functionsgenerating functionalglueball

Hot Scholars

SC

Shaoshi Chen

KLMM, AMSS, Chinese Academy of Sciences
Symbolic ComputationDifferential and Difference Algebra
RR

Reza Rezaeian Farashahi

Assistant Professor, Dept. of Mathematical Sciences, Isfahan University of Technology
Algebraic aspects in CryptographyElliptic and Hyperelliptic Curve CryptographyComputational Number Theory.
SS

Simone Servadio

Assistant Professor, Iowa State University
EstimationFilteringUncertainty PropagationSSA
US

Uri Shapira

Professor Technion Israel
Dynamical systems