Image and depth from a conventional camera with a coded aperture

Anat Levin, Rob Fergus, Frédo Durand, William T. Freeman

Research output: Contribution to conferencePaperpeer-review

Abstract

A conventional camera captures blurred versions of scene information away from the plane of focus. Camera systems have been proposed that allow for recording all-focus images, or for extracting depth, but to record both simultaneously has required more extensive hardware and reduced spatial resolution. We propose a simple modification to a conventional camera that allows for the simultaneous recovery of both (a) high resolution image information and (b) depth information adequate for semi-automatic extraction of a layered depth representation of the image. Our modification is to insert a patterned occluder within the aperture of the camera lens, creating a coded aperture. We introduce a criterion for depth discriminability which we use to design the preferred aperture pattern. Using a statistical model of images, we can recover both depth information and an all-focus image from single photographs taken with the modified camera. A layered depth map is then extracted, requiring user-drawn strokes to clarify layer assignments in some cases. The resulting sharp image and layered depth map can be combined for various photographic applications, including automatic scene segmentation, post-exposure refocusing, or re-rendering of the scene from an alternate viewpoint.

Original languageEnglish (US)
DOIs
StatePublished - 2007
Event34th Annual Meeting of the Association for Computing Machinery's Special Interest Group on Graphics - San Diego, CA, United States
Duration: Aug 5 2007Aug 9 2007

Other

Other34th Annual Meeting of the Association for Computing Machinery's Special Interest Group on Graphics
CountryUnited States
CitySan Diego, CA
Period8/5/078/9/07

Keywords

  • Coded imaging
  • Computational photography
  • Deblurring
  • Depth of field
  • Image statistics
  • Range estimation

ASJC Scopus subject areas

  • Computer Science(all)

Fingerprint Dive into the research topics of 'Image and depth from a conventional camera with a coded aperture'. Together they form a unique fingerprint.

Cite this