ProxyBuild: Text-Guided Structured 3D Building Generation with Mesh-Anchored Procedural Proxies

📅 2026-09-20
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
ProxyBuild通过Mesh-Anchored Procedural Proxy方法解决文本引导的3D建筑生成问题,实现结构清晰、细节丰富且可编辑的3D建筑生成。
📝 Abstract
Text-guided 3D building generation holds tremendous application potential, yet existing generative models typically output inseparable single meshes or non-interactive rendered representations. While procedural modeling can generate editable buildings with hierarchical structures, rule authoring is laborious, and even with the aid of large language models (LLMs), it remains challenging to effectively solve procedural rules under geometric constraints. In this paper, we propose ProxyBuild, a novel hybrid framework for structured building generation. We introduce the Mesh-Anchored Procedural Proxy (MAPP) as a novel intermediate representation, which tightly anchors building components onto geometric shells, thereby decoupling the generation task into two phases: proxy prediction and proxy-to-asset instantiation. First, we construct a building dataset with MAPP annotations to train our designed face-edge bigraph encoder. By explicitly modeling the feature interactions of topological elements on heterogeneous mesh graphs, this encoder accurately infers the semantic roles of faces and edges. Subsequently, conditioned on textual styles and attribute parameters parsed by LLMs, we accomplish high-precision asset retrieval and assembly by integrating a spatial placement logic with hard constraints. Extensive experiments show that ProxyBuild not only significantly mitigates common issues in building generation such as over-smoothing, component collisions, and structural corruptions, but also accurately parses semantic-free shells from diverse sources. Outperforming prior baselines across various metrics, our method can robustly generate structurally clear, detail-rich, and post-editable 3D buildings from text, thereby providing a reliable and interactive content foundation for downstream applications such as virtual reality and digital twins.
Problem

Research questions and friction points this paper is trying to address.

Text-guided 3D building generation
Procedural modeling
Geometric constraints
Hierarchical structures
Innovation

Methods, ideas, or system contributions that make the work stand out.

Mesh-Anchored Procedural Proxy
face-edge bigraph encoder
text-guided 3D building generation
proxy-to-asset instantiation
spatial placement logic
🔎 Similar Papers
No similar papers found.
💼 Related Jobs
No related jobs found.
X
Xiang Tang
Harbin Institute of Technology, Shenzhen; Pengcheng Laboratory
Ruotong Li
Ruotong Li
Pengcheng Laboratory
Xiaopeng Fan
Xiaopeng Fan
Professor, Harbin Institute of Technology
Video/ImageWireless