Polynomial Chaos Expanded Gaussian Process

📅 2024-05-02
🏛️ arXiv.org
📈 Citations: 1
✨ Influential: 0
📄 PDF
🤖 AI Summary
To address the insufficient local accuracy of global models in modeling complex, unknown processes, this paper proposes the PCEGP method: Polynomial Chaos Expansion (PCE) is employed—novelly and for the first time—to dynamically generate input-dependent hyperparameters for Gaussian Processes (GPs), thereby constructing a nonstationary covariance function and an heteroscedastic noise estimation mechanism. The approach ensures mathematical interpretability, modeling transparency, and prediction traceability, eliminating the need for explicit spatial partitioning and multiple model training inherent in conventional local modeling strategies. Evaluated across multiple regression benchmarks, PCEGP consistently achieves significantly lower prediction errors, with accuracy and generalization performance matching or surpassing state-of-the-art methods. It establishes a new paradigm for high-confidence surrogate modeling in complex system identification and uncertainty quantification.

Technology Category

Machine Learning: Calibration & Uncertainty QuantificationReasoning under Uncertainty: Stochastic OptimizationSearch and Optimization: Mixed Discrete/Continuous Search

Application Category

Graph Algorithms and Modeling for the Web: Efficient manipulation of static and dynamic Web-related graphsUser Modeling, Personalization and Recommendation: Explainable and interpretable methods for personalizationWeb Mining and Content Analysis: Models for Web evolution
📝 Abstract
In complex and unknown processes, global models are initially generated over the entire experimental space, but they often fail to provide accurate predictions in local areas. Recognizing this limitation, this study addresses the need for models that effectively represent both global and local experimental spaces. It introduces a novel machine learning (ML) approach: Polynomial Chaos Expanded Gaussian Process (PCEGP), leveraging polynomial chaos expansion (PCE) to calculate input-dependent hyperparameters of the Gaussian process (GP). This approach provides a mathematically interpretable method that incorporates non-stationary covariance functions and heteroscedastic noise estimation to generate locally adapted models. The model performance is compared to different algorithms in benchmark tests for regression tasks. The results demonstrate low prediction errors of the PCEGP in these benchmark applications, highlighting model performance that is often competitive with or superior to previous methods. A key advantage of the presented model is the transparency and traceability in the calculation of hyperparameters and model predictions.
Problem

Research questions and friction points this paper is trying to address.

Global models often fail in local predictions
Need models for both global and local accuracy
Existing local models add significant complexity
Innovation

Methods, ideas, or system contributions that make the work stand out.

PCEGP combines polynomial chaos with Gaussian process
Non-stationary covariance for locally adapted models
Interpretable hyperparameters with competitive runtime
💼 Related Jobs
No related jobs found.
University of Applied Sciences Niederrhein | University of Duisburg-Essen
D
Dominik Polke
Electrical Engineering and Computer Science, University of Applied Sciences Niederrhein
T
Tim Kösters
Electrical Engineering and Computer Science, University of Applied Sciences Niederrhein
E
Elmar Ahle
Electrical Engineering and Computer Science, University of Applied Sciences Niederrhein
D
Dirk Söffker
Dynamics and Control, University of Duisburg-Essen