3D-MetaConNet: Meta-learning for 3D Shape Classification and Segmentation

Hao Huang, Xiang Li, Lingjing Wang, Yi Fang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Supervised learning on 3D shapes are extensively studied by prior literature,among which PointNet [29] and its variants PointNet++ [31] are representatives. However,these methods tackle 3D shape learning problems by training from scratch using a fixed learning algorithm over large amounts of labeled data,potentially challenged by data and computation bottlenecks. In the paper,we design a novel model,under the framework of meta-learning,to learn 3D shape representation. By training over multiple 3D tasks,each of which is defined as a supervised learning problem,our method can fast adapt to unseen tasks containing limited labeled data. Specifically,our model consists of a 3Dmeta-learner and a task-oriented 3D-learner,where the 3D-meta-learner produces parameter initialization for the 3D-learner after being trained over different tasks. With adaptively initialized parameters,the 3D-learner can be tuned rapidly in a few steps to achieve good performance on novel tasks with a small amount of training data. To further facilitate discriminative shape feature learning,we introduce a novel task-aware feature adaptation module under a contrastive learning scheme,in which all shapes in each task are considered as a whole and task-oriented compact features are learned. Therefore,we dub our model as 3DMetaConNet. Experiments on three public 3D datasets for few-shot shape classification and segmentation demonstrate that our method can learn compact and discriminative 3D shape features efficiently and robustly in a fast adaptation manner. Our method particularly outperforms the methods without a meta-learning framework and is also superior to existing meta-learning approaches.

Original languageEnglish (US)
Title of host publicationProceedings - 2021 International Conference on 3D Vision, 3DV 2021
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages982-991
Number of pages10
ISBN (Electronic)9781665426886
DOIs
StatePublished - 2021
Event9th International Conference on 3D Vision, 3DV 2021 - Virtual, Online, United Kingdom
Duration: Dec 1 2021Dec 3 2021

Publication series

NameProceedings - 2021 International Conference on 3D Vision, 3DV 2021

Conference

Conference9th International Conference on 3D Vision, 3DV 2021
Country/TerritoryUnited Kingdom
CityVirtual, Online
Period12/1/2112/3/21

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Vision and Pattern Recognition

Fingerprint

Dive into the research topics of '3D-MetaConNet: Meta-learning for 3D Shape Classification and Segmentation'. Together they form a unique fingerprint.

Cite this