StepCAD: Mesh-to-CAD Code Generation via LLM Policy and Geometry-Guided Search

📅 2026-10-01
📈 Citations: 0
✨ Influential: 0
📄 PDF
🤖 AI Summary
This study addresses the limitations of recovering executable CAD programs from 3D meshes, specifically the difficulty in handling diverse modeling operations and correcting geometric errors. To this end, we propose a generative optimization framework that introduces a pioneering step-wise generation mechanism. Our method leverages large language models to predict modeling actions, integrating intermediate geometric states with an IoU-guided tree search to enable local editing and iterative refinement. Furthermore, we release ARCADE-1.5M, a large-scale dataset encompassing multi-operation CAD sequences. Extensive experiments demonstrate that our approach achieves state-of-the-art reconstruction accuracy across multiple benchmarks, yielding a relative IoU improvement of up to 87.2% on complex shapes while maintaining high program validity.
📝 Abstract
Recovering executable CAD programs from 3D meshes is challenging due to the compositional nature of CAD construction and the interaction between discrete modeling choices and continuous parameters. Many learning-based methods predict complete programs in a single pass and rely predominantly on sketch-extrude representations, limiting operation diversity and opportunities to correct geometric errors during reconstruction. We introduce StepCAD, a generative optimization approach that combines a state-conditioned CAD policy with geometry-guided search. Given an input mesh, the policy predicts construction actions conditioned on both target and intermediate geometry, and an IoU-guided tree search refines the resulting program through local edits. We also introduce ARCADE-1.5M, a large-scale dataset of 1.5M executable CAD programs spanning diverse operations, sequences with a maximum length of 150+ counted operations, and 12.5M intermediate state-action transitions. Experiments across multiple CAD reconstruction benchmarks show that StepCAD achieves state-of-the-art geometric reconstruction accuracy with consistently high validity, yielding up to 87.2% relative IoU improvement over the strongest evaluated baseline, with particularly large gains on complex shapes. Project page: https://ghadinehme.com/stepcad.github.io/
Problem

Research questions and friction points this paper is trying to address.

3D mesh to CAD
CAD program generation
geometric reconstruction
mesh-to-CAD
Innovation

Methods, ideas, or system contributions that make the work stand out.

Mesh-to-CAD
LLM Policy
Geometry-Guided Search
Tree Search
CAD Program Generation
🔎 Similar Papers
💼 Related Jobs
No related jobs found.
G
Ghadi Nehme
Department of Mechanical Engineering, Massachusetts Institute of Technology, Cambridge, MA 02139
Faez Ahmed
Faez Ahmed
Associate Professor, MIT
Generative AIEngineering DesignMachine LearningEngineering OptimizationData-driven Design