Artificial Neural Networks as Surrogate Models in Black Box Optimization

📅 2026-09-16
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
本文提出了一种基于人工神经网络的替代模型AFN-CMA-ES,用于黑盒优化中目标函数的选择性评估,以减少昂贵或耗时的函数评估次数。
📝 Abstract
Black-Box Optimization (BBO) is often applied in several engineering fields and can utilize an advancement of numerical measure- ments and simulation technologies. It deals with the optimization func- tions, where an analytical description is unavailable. It relies on meth- ods that require only an input point in the search space, paired with its corresponding objective function value, obtained through non-analytical means, e.g., sensors, experiments, or simulations. Common approaches include evolutionary optimization and other metaheuristics. Since BBO methods rely solely on objective function values, they typically require many evaluations, which becomes problematic when evaluating the ob- jective function is time-consuming or expensive. This leads to using surrogate-based optimization which evaluates selected true objective val- ues and trains a regression model to approximate the objective function across the search space. Surrogate-assisted black-box optimization is a small-data learning problem because the optimizer must approximate an expensive objective function from limited evaluations. Surrogate models act as data-efficient regressors, guiding the search toward promising or informative points under a restricted evaluation budget. In this paper, a new surrogate model using artificial neural networks, called Adaptive- Fidelity Nexus Covariance Matrix Adaptation Evolution Strategy (AFN- CMA-ES), is proposed for the selective evaluation of objective functions. The experimental results show its competitive performance compared to state-of-the-art surrogate-assisted BBO methods.
Problem

Research questions and friction points this paper is trying to address.

Black-Box Optimization
Surrogate Model
Objective Function Evaluation
Innovation

Methods, ideas, or system contributions that make the work stand out.

Artificial Neural Networks
Surrogate Models
Black-Box Optimization
AFN-CMA-ES
💼 Related Jobs
No related jobs found.
M
Md Khadimul Islam Zim
Czech Academy of Sciences, Institute of Computer Science, Pod Vodárenskou věží 2, Prague, Czech Republic
M
Martin Holeňa
Czech Academy of Sciences, Institute of Computer Science, Pod Vodárenskou věží 2, Prague, Czech Republic