On Some Tunable Multi-fidelity Bayesian Optimization Frameworks

📅 2025-08-01
📈 Citations: 0
✨ Influential: 0
📄 PDF
🤖 AI Summary
In multi-fidelity Gaussian process Bayesian optimization, fidelity selection is complex, high-fidelity evaluations are prohibitively expensive, and existing strategies lack consistency. To address these challenges, this paper proposes a unified multi-fidelity acquisition framework grounded in proximity. Its core contributions are: (1) a tunable multi-fidelity upper confidence bound (MF-UCB) strategy that explicitly controls the frequency of high-fidelity evaluations; and (2) a weighted proximity-based acquisition function that jointly optimizes fidelity selection and candidate point selection by integrating information from all fidelity-level surrogate models. Evaluated on chemical kinetics optimization tasks—including homogeneous and heterogeneous catalysis—the method achieves significantly faster convergence while reducing high-fidelity evaluations by 30–50%, striking a superior trade-off between exploration efficiency and evaluation cost.

Technology Category

Search and Optimization: Sampling/Simulation-based SearchReasoning under Uncertainty: Stochastic OptimizationConstraint Satisfaction and Optimization: Constraint Learning and Acquisition

Application Category

Search and Retrieval-Augmented AI: Web learning to rank, online learning, and counterfactual learning for rankingGraph Algorithms and Modeling for the Web: Representation, reconstruction, and subgraph or motif discovery in Web-related graphsUser Modeling, Personalization and Recommendation: Fairness-aware retrieval and ranking
📝 Abstract
Multi-fidelity optimization employs surrogate models that integrate information from varying levels of fidelity to guide efficient exploration of complex design spaces while minimizing the reliance on (expensive) high-fidelity objective function evaluations. To advance Gaussian Process (GP)-based multi-fidelity optimization, we implement a proximity-based acquisition strategy that simplifies fidelity selection by eliminating the need for separate acquisition functions at each fidelity level. We also enable multi-fidelity Upper Confidence Bound (UCB) strategies by combining them with multi-fidelity GPs rather than the standard GPs typically used. We benchmark these approaches alongside other multi-fidelity acquisition strategies (including fidelity-weighted approaches) comparing their performance, reliance on high-fidelity evaluations, and hyperparameter tunability in representative optimization tasks. The results highlight the capability of the proximity-based multi-fidelity acquisition function to deliver consistent control over high-fidelity usage while maintaining convergence efficiency. Our illustrative examples include multi-fidelity chemical kinetic models, both homogeneous and heterogeneous (dynamic catalysis for ammonia production).
Problem

Research questions and friction points this paper is trying to address.

Develops tunable multi-fidelity Bayesian optimization frameworks
Simplifies fidelity selection with proximity-based acquisition strategy
Enables multi-fidelity UCB strategies with multi-fidelity GPs
Innovation

Methods, ideas, or system contributions that make the work stand out.

Proximity-based acquisition simplifies fidelity selection
Multi-fidelity UCB combined with multi-fidelity GPs
Benchmarking performance and high-fidelity evaluation reliance
💼 Related Jobs
No related jobs found.
A
Arjun Manoj
Department of Chemical and Biomolecular Engineering, Johns Hopkins University, U.S.A.
A
Anastasia S. Georgiou
Department of Chemical and Biomolecular Engineering, Johns Hopkins University, U.S.A.
D
Dimitris G. Giovanis
Department of Civil and Systems Engineering, Johns Hopkins University, U.S.A.
T
Themistoklis P. Sapsis
Department of Mechanical Engineering, Massachusetts Institute of Technology, U.S.A.
I
Ioannis G. Kevrekidis
Department of Chemical and Biomolecular Engineering, Johns Hopkins University, U.S.A.; Department of Applied Mathematics and Statistics, Johns Hopkins University, U.S.A.