Approximation of Box Decomposition Algorithm for Fast Hypervolume-Based Multi-Objective Optimization

📅 2025-12-05
📈 Citations: 0
✨ Influential: 0
📄 PDF
🤖 AI Summary
In multi-objective Bayesian optimization, the high computational cost of hypervolume (HV) computation—especially in high-dimensional objective spaces—severely hampers acquisition function optimization. To address this, we propose an efficient and scalable box-decomposition-based approximation algorithm. Our method systematically constructs low-complexity approximations of HV increments, reducing worst-case memory complexity from superpolynomial to polynomial. This work provides, for the first time, a rigorous mathematical formulation of the approximation, a formal convergence analysis, and fully reproducible implementation details—thereby bridging critical gaps in theoretical rigor and algorithmic clarity present in prior literature. Empirical results demonstrate that our approach maintains solution-set quality while significantly accelerating HV improvement computation, particularly in high-dimensional objective spaces. The method thus offers practical scalability for large-scale multi-objective optimization.

Technology Category

Search and Optimization: Sampling/Simulation-based SearchReasoning under Uncertainty: Stochastic OptimizationMachine Learning: Optimization

Application Category

Graph Algorithms and Modeling for the Web: Algorithms and analysis for incomplete, noisy, or partially observed Web-related graphsEconomics, Online Markets and Human Computation: Fairness, privacy, and diversity in economic environmentsSearch and Retrieval-Augmented AI: Efficiency and scalability of Web search engines
📝 Abstract
Hypervolume (HV)-based Bayesian optimization (BO) is one of the standard approaches for multi-objective decision-making. However, the computational cost of optimizing the acquisition function remains a significant bottleneck, primarily due to the expense of HV improvement calculations. While HV box-decomposition offers an efficient way to cope with the frequent exact improvement calculations, it suffers from super-polynomial memory complexity $O(MN^{lfloor frac{M + 1}{2} floor})$ in the worst case as proposed by Lacour et al. (2017). To tackle this problem, Couckuyt et al. (2012) employed an approximation algorithm. However, a rigorous algorithmic description is currently absent from the literature. This paper bridges this gap by providing comprehensive mathematical and algorithmic details of this approximation algorithm.
Problem

Research questions and friction points this paper is trying to address.

Approximates box decomposition for hypervolume improvement
Reduces computational cost in multi-objective Bayesian optimization
Addresses super-polynomial memory complexity of exact calculations
Innovation

Methods, ideas, or system contributions that make the work stand out.

Approximates box decomposition for hypervolume calculations
Reduces memory complexity in Bayesian optimization
Provides rigorous algorithmic details for approximation method
💼 Related Jobs
No related jobs found.
S
Shuhei Watanabe
Preferred Networks Inc.