Noisy depth maps fusion for multiview stereo via matrix completion

Yue Deng, Yebin Liu, Qionghai Dai, Zengke Zhang, Yao Wang

Research output: Contribution to journalArticlepeer-review


This paper introduces a general framework to fuse noisy point clouds from multiview images of the same object. We solve this classical vision problem using a newly emerging signal processing technique known as matrix completion. With this framework, we construct the initial incomplete matrix from the observed point clouds by all the cameras, with the invisible points by any camera denoted as unknown entries. The observed points corresponding to the same object point are put into the same row. When properly completed, the recovered matrix should have rank one, since all the columns describe the same object. Therefore, an intuitive approach to complete the matrix is by minimizing its rank subject to consistency with observed entries. In order to improve the fusion accuracy, we propose a general noisy matrix completion method called log-sum penalty completion (LPC), which is particularly effective in removing outliers. Based on the majorization-minimization algorithm (MM), the non-convex LPC problem is effectively solved by a sequence of convex optimizations. Experimental results on both point cloud fusion and MVS reconstructions verify the effectiveness of the proposed framework and the LPC algorithm.

Original languageEnglish (US)
Article number6187689
Pages (from-to)566-582
Number of pages17
JournalIEEE Journal on Selected Topics in Signal Processing
Issue number5
StatePublished - 2012


  • Compressive sensing
  • fusion
  • matrix completion
  • multiview stereo (MVS)
  • point cloud

ASJC Scopus subject areas

  • Signal Processing
  • Electrical and Electronic Engineering


Dive into the research topics of 'Noisy depth maps fusion for multiview stereo via matrix completion'. Together they form a unique fingerprint.

Cite this