🤖 AI Summary
This study addresses the limitations of recovering executable CAD programs from 3D meshes, specifically the difficulty in handling diverse modeling operations and correcting geometric errors. To this end, we propose a generative optimization framework that introduces a pioneering step-wise generation mechanism. Our method leverages large language models to predict modeling actions, integrating intermediate geometric states with an IoU-guided tree search to enable local editing and iterative refinement. Furthermore, we release ARCADE-1.5M, a large-scale dataset encompassing multi-operation CAD sequences. Extensive experiments demonstrate that our approach achieves state-of-the-art reconstruction accuracy across multiple benchmarks, yielding a relative IoU improvement of up to 87.2% on complex shapes while maintaining high program validity.
📝 Abstract
Recovering executable CAD programs from 3D meshes is challenging due to the compositional nature of CAD construction and the interaction between discrete modeling choices and continuous parameters. Many learning-based methods predict complete programs in a single pass and rely predominantly on sketch-extrude representations, limiting operation diversity and opportunities to correct geometric errors during reconstruction. We introduce StepCAD, a generative optimization approach that combines a state-conditioned CAD policy with geometry-guided search. Given an input mesh, the policy predicts construction actions conditioned on both target and intermediate geometry, and an IoU-guided tree search refines the resulting program through local edits. We also introduce ARCADE-1.5M, a large-scale dataset of 1.5M executable CAD programs spanning diverse operations, sequences with a maximum length of 150+ counted operations, and 12.5M intermediate state-action transitions. Experiments across multiple CAD reconstruction benchmarks show that StepCAD achieves state-of-the-art geometric reconstruction accuracy with consistently high validity, yielding up to 87.2% relative IoU improvement over the strongest evaluated baseline, with particularly large gains on complex shapes. Project page: https://ghadinehme.com/stepcad.github.io/