Removal of Redundant Candidate Points for the Exact D-Optimal Design Problem

๐Ÿ“… 2025-08-31
๐Ÿ“ˆ Citations: 0
โœจ Influential: 0
๐Ÿ“„ PDF
๐Ÿค– AI Summary
Computing exact D-optimal designs over large finite candidate sets is computationally prohibitive due to excessive memory and time requirements. Method: We propose a redundancy elimination method grounded in necessary conditions for approximate designs. It integrates convex optimization to compute an approximate design, integer-constrained screening to identify candidate support points, and mixed-integer second-order cone programming to recover the exact optimal solution. Contribution/Results: We establish, for the first time, a theoretical link between approximate and exact designsโ€”proving that, asymptotically, the optimal support set is contained within the maximum-variance subset. This enables stepwise, order-of-magnitude compression of the candidate set. Our approach reduces candidate sets with tens of millions of points by several orders of magnitude, solves previously intractable large-scale instances, and delivers solutions with certified global optimality.

Technology Category

Search and Optimization: Mixed Discrete/Continuous SearchConstraint Satisfaction and Optimization: Mixed Discrete/Continuous OptimizationReasoning under Uncertainty: Stochastic Optimization

Application Category

Graph Algorithms and Modeling for the Web: Algorithms and analysis for incomplete, noisy, or partially observed Web-related graphsEconomics, Online Markets and Human Computation: Data quality aspects of human-annotated datasetsSecurity and Privacy: Large-scale security measurements
๐Ÿ“ Abstract
One of the most common problems in statistical experimentation is computing D-optimal designs on large finite candidate sets. While optimal approximate (i.e., infinite-sample) designs can be efficiently computed using convex methods, constructing optimal exact (i.e., finite-sample) designs is a substantially more difficult integer-optimization problem. In this paper, we propose necessary conditions, based on approximate designs, that must be satisfied by any support point of a D-optimal exact design. These conditions enable rapid elimination of redundant candidate points without loss of optimality, thereby reducing memory requirements and runtime of subsequent exact design algorithms. In addition, we prove that for sufficiently large sample sizes, the supports of D-optimal exact designs are contained in a typically small maximum-variance set. We demonstrate the approach on randomly generated benchmark models with candidate sets up to 100 million points, and on commonly used constrained mixture models with up to one million points. The proposed approach reduces the initial candidate sets by several orders of magnitude, thereby making it possible to compute exact D-optimal designs for these problems via mixed-integer second-order cone programming, which provides optimality guarantees.
Problem

Research questions and friction points this paper is trying to address.

Reducing large candidate sets for exact D-optimal designs
Eliminating redundant points without losing optimality guarantees
Enabling exact design computation via mixed-integer optimization
Innovation

Methods, ideas, or system contributions that make the work stand out.

Eliminating redundant points using approximate design conditions
Proving optimal designs lie in small maximum-variance sets
Enabling mixed-integer programming for large candidate sets
๐Ÿ”Ž Similar Papers
๐Ÿ’ผ Related Jobs
No related jobs found.
R
Radoslav Harman
Faculty of Mathematics, Physics and Informatics, Comenius University, Mlynska Dolina F1, Bratislava, 842 48, Slovakia
S
Samuel Rosa
Faculty of Mathematics, Physics and Informatics, Comenius University, Mlynska Dolina F1, Bratislava, 842 48, Slovakia