Unsupervised Category-Specific Partial Point Set Registration via Joint Shape Completion and Registration

Xiang Li, Lingjing Wang, Yi Fang

Research output: Contribution to journalArticlepeer-review


We propose a self-supervised method for partial point set registration. Although recently proposed learning-based methods demonstrate impressive registration performance on full shape observations, these methods often suffer from performance degradation when dealing with partial shapes. To bridge the performance gap between partial and full point set registration, we propose to incorporate a shape completion network to benefit the registration process. To achieve this, we introduce a learnable latent code for each pair of shapes, which can be regarded as the geometric encoding of the target shape. By doing so, our model does not require an explicit feature embedding network to learn the feature encodings. More importantly, both our shape completion and point set registration networks take the shared latent codes as input, which are optimized simultaneously with the parameters of two decoder networks in the training process. Therefore, the point set registration process can benefit from the joint optimization process of latent codes, which are enforced to represent the information of full shapes instead of partial ones. In the inference stage, we fix the network parameters and optimize the latent codes to obtain the optimal shape completion and registration results. Our proposed method is purely unsupervised and does not require ground truth supervision. Experiments on the ModelNet40 dataset demonstrate the effectiveness of our model for partial point set registration.

Original languageEnglish (US)
Pages (from-to)3251-3265
Number of pages15
JournalIEEE Transactions on Visualization and Computer Graphics
Issue number7
StatePublished - Jul 1 2023


  • Point set registration
  • partial registration
  • shape completion
  • unsupervised learning

ASJC Scopus subject areas

  • Software
  • Signal Processing
  • Computer Vision and Pattern Recognition
  • Computer Graphics and Computer-Aided Design


Dive into the research topics of 'Unsupervised Category-Specific Partial Point Set Registration via Joint Shape Completion and Registration'. Together they form a unique fingerprint.

Cite this