register meshes

Designs and implements methods to compute spatial correspondences and transformations that align 3D surface meshes with other meshes or with point clouds, producing rigid or nonrigid registrations and dense deformation fields. Builds optimization and constraint-based frameworks to regularize those deformations, enforce geometric or physical plausibility, and fuse measurements to correct observed shape changes and handle missing or noisy data.

registermeshes

Recent Skill Trend

Momentum and market value over time
Trending
Score
No comparison yet
0
Oct 01, 2026Oct 01, 2026
Career
Value
No comparison yet
$201K/year
Oct 01, 2026Oct 01, 2026

Must-Read Papers

Most classic and influential ideas
View more

Physically Compatible 3D Object Modeling from a Single Image

May 30, 2024
MG
Minghao Guo
🏛️ MIT | UMass Amherst

This work addresses the lack of physical plausibility in single-image 3D reconstruction. We propose the first physics-compatible reconstruction framework that enforces static equilibrium as a hard constraint. Methodologically, we explicitly decouple and jointly optimize material stiffness, external loading forces, and the static equilibrium geometry; deformation responses are modeled via differentiable physics simulation, enabling gradient-based joint optimization of all variables. Our approach breaks from conventional simplifications—such as rigid-body assumptions or neglect of external forces—by embedding real-world physical constraints directly into the single-image reconstruction pipeline. Evaluated on Objaverse, our method yields reconstructions with significantly improved mechanical stability, suitable for downstream dynamic simulation and 3D printing. Physical validation via real-world force testing further confirms the structural robustness of the generated models.

3D modelingmaterial propertiesphysical stability

SPARE: Symmetrized Point-to-Plane Distance for Robust Non-Rigid Registration

May 30, 2024
YY
Yuxin Yao
🏛️ University of Science and Technology of China | Cardiff University | City University of Hong Kong

Traditional point-to-point or point-to-plane distance metrics in non-rigid point cloud registration suffer from slow convergence and geometric detail loss. To address this, we propose a symmetric point-to-plane distance metric that jointly enforces positional and normal-based geometric constraints, significantly improving geometric fidelity. Methodologically, we introduce the first symmetric distance formulation for non-rigid registration and integrate it with a deformation-graph-based coarse alignment followed by an alternating optimization scheme within the Majorization-Minimization (MM) framework—balancing robustness, accuracy, and efficiency. Extensive experiments on multiple benchmark datasets demonstrate that our approach achieves state-of-the-art registration accuracy while maintaining high computational efficiency. The source code is publicly available.

Addresses slow convergence and detail loss in surface alignmentEnhances geometry approximation using positions and normals of pointsImproves non-rigid registration accuracy with symmetrized point-to-plane distance

Geometry-aware Feature Matching for Large-Scale Structure from Motion

Sep 03, 2024
GC
Gonglin Chen
🏛️ University of Southern California | The Ohio State University

In large-scale Structure-from-Motion (SfM), sparse inter-view overlap and drastic viewpoint changes—especially in aerial-to-ground scenarios—lead to low cross-image feature matching density and weak geometric consistency. To address this, we propose a geometry-guided hybrid matching paradigm: (1) geometric verification is formulated as an optimization problem based on Sampson distance; (2) detector-agnostic dense matching is fused with detector-driven sparse anchor guidance, where sparse anchors constrain and enhance the geometric consistency of dense matches; and (3) multi-view geometric consistency is explicitly modeled. Our method significantly improves both matching density and accuracy, outperforming state-of-the-art approaches in extreme large-scale settings. Consequently, camera pose estimation becomes more accurate, and the reconstructed 3D point cloud achieves higher completeness and fidelity.

Combining detector-free and detector-based methods for geometric consistencyEnhancing feature matching with geometry cues for large-scale SfMImproving correspondence density and accuracy in sparse view overlap

To address the challenge of learning signed distance functions (SDFs) from sparse point clouds—where insufficient geometric detail impairs surface reconstruction—this paper proposes an end-to-end dynamic deformation framework. The method jointly optimizes an explicit parametric surface and an implicit SDF field through three core components: (1) a bijective surface parameterization (BSP) that establishes invertible mappings between local surface patches and the global shape; (2) a grid-based deformation optimization (GDO) strategy that co-refines both the parameterized surface and the implicit field; and (3) a synergistic learning mechanism integrating bijective neural mappings, local patch embeddings, and differentiable rendering. Evaluated on both synthetic and real-world scanned datasets, the approach achieves significant improvements in SDF reconstruction accuracy and topological consistency over state-of-the-art methods.

Inferring signed distance functions from sparse point cloudsLearning global shape from local patches via bijective parameterizationOptimizing grid deformation for refined surface approximation

Diff-PCR: Diffusion-Based Correspondence Searching in Doubly Stochastic Matrix Space for Point Cloud Registration

Dec 31, 2023
QW
Qianliang Wu
🏛️ Nanjing University of Science and Technology

In point cloud registration, existing methods suffer from fixed iterative optimization paths, implicit correspondence refinement, and single-projection updates prone to local optima. This work introduces, for the first time, denoising diffusion models into the space of doubly stochastic matrices to explicitly model and optimize the distribution of matching matrices. Instead of fixed iterations, it employs the diffusion reverse process—enabling initialization from arbitrary inputs (e.g., white noise)—and integrates Sinkhorn regularization with differentiable geometric feature encoding to enable gradient-guided global matching search. Evaluated on 3DMatch/3DLoMatch and 4DMatch/4DLoMatch benchmarks, our approach achieves significant improvements in both rigid and non-rigid registration accuracy, correspondence quality, and robustness over RAFT-style methods and conventional feature-distance-based approaches.

Finding optimal correspondences between point clouds efficientlyOvercoming limitations of iterative refinement in existing methodsPredicting searching gradient for optimal matching matrix using diffusion model

Latest Papers

What's happening recently
View more

This study addresses the fundamental challenge of estimating correspondences between 3D shape instances under non-rigid deformations by providing a systematic review of existing approaches, which it categorizes into three major paradigms: spectral methods based on functional maps, combinatorial methods incorporating discrete constraints, and deformation-based techniques that directly recover global alignment. For the first time, these three lines of work are unified within a coherent framework, clarifying their historical development, respective strengths, and limitations. A key contribution lies in demonstrating the emerging potential of vision foundation models for zero-shot correspondence tasks. The paper further highlights pressing challenges such as local shape matching, identifies current bottlenecks, and outlines promising future directions, thereby offering both a comprehensive theoretical foundation and practical guidance for advancing research in this domain.

Correspondence EstimationDeformationNon-Rigid 3D Shape Correspondence

This work proposes DC-Reg, a novel framework addressing the challenge of achieving globally optimal point cloud registration under partial overlap and large initial misalignment. The method introduces a unified difference-of-convex (DC) decomposition of the coupled objective function involving both transformation and correspondence variables, enabling the construction of a globally concave lower bound that significantly tightens the search space in branch-and-bound (BnB) optimization. By jointly exploiting the structural interdependence between transformation and correspondence variables, DC-Reg overcomes the limitations of conventional per-term relaxation strategies. Integrated with rotation-invariant features and an efficient solver for the linear assignment problem, the approach demonstrates faster convergence than existing global methods on both synthetic data and the 3DMatch benchmark, while exhibiting superior robustness under extreme noise and outlier conditions.

global optimalitylarge misalignmentnon-convex optimization

Recovering editable, parameterized CAD construction sequences from geometric inputs such as meshes remains a fundamental challenge in design and manufacturing. This work proposes an IoU-driven hybrid optimization framework that, for the first time, formulates the reconstruction problem as structured CAD program optimization. By leveraging geometric feedback, the method iteratively fits and validates a rich set of parametric operations—including fillets and chamfers—within the procedural representation. The approach enables end-to-end image-to-CAD reconstruction across multiple modalities and significantly outperforms existing methods on established benchmarks, achieving superior performance in both volumetric IoU and Chamfer distance metrics. Moreover, it substantially reduces redundancy in the reconstructed programs, enabling efficient and high-fidelity recovery of complex CAD models.

construction sequence recoveryeditable CAD modelsgeometric reverse engineering

This work proposes a parameter-free local topographic descriptor for the comparison and rigid alignment of three-dimensional structured point patterns. The method decomposes each point pattern into multiple arms and introduces a normalized finite difference operator along each arm to capture the local variation of height components relative to the underlying planar geometry, thereby integrating fine-grained geometric details with global structural information. By combining Wasserstein distance with Procrustes analysis, the approach enables efficient distributional comparison and precise alignment of point clouds. The proposed descriptor preserves salient local topographic features while significantly enhancing the robustness and accuracy of point pattern matching.

geometric patternlocal topographypoint cloud

Existing methods for non-rigid mesh sequence registration often suffer from reliance on per-instance optimization, limited category generalization, support for only pairwise inputs, or incomplete output correspondences. This work proposes a feed-forward neural network that leverages a topology-aware point representation and a multimodal encoding scheme to construct a global motion embedding, enabling a lightweight decoder to directly predict vertex deformations. The approach achieves efficient and complete multi-frame registration without iterative optimization and inherently supports motion interpolation at arbitrary time steps as well as high-quality mesh morphing. It demonstrates state-of-the-art performance across diverse object categories and complex non-rigid motions.

mesh morphingmesh sequencesmotion interpolation

Hot Scholars

RB

Richard Bowden

Professor of Computer Vision and Machine Learning, CVSSP, University of Surrey
Computer VisionMachine learningArtificial Intelligence
SS

Shunsuke Saito

Research Scientist, Meta Codec Avatars Lab
Digital HumansComputer VisionComputer Graphics
MH

Marc Habermann

Senior Researcher, Max Planck Institute for Informatics
Computer VisionComputer GraphicsMachine LearningHuman Performance Capture
MN

Matthias Nießner

Professor of Computer Science, Technical University of Munich
Computer GraphicsComputer VisionArtificial IntelligenceMachine Learning