The perceptive workbench: Computer-vision-based gesture tracking, object tracking, and 3D reconstruction for augmented desks

Thad Starner, Bastian Leibe, David Minnen, Tracy Westyn, Amy Hurst, Justin Weeks

Research output: Contribution to journalArticle

Abstract

The Perceptive Workbench endeavors to create a spontaneous and unimpeded interface between the physical and virtual worlds. Its vision-based methods for interaction constitute an alternative to wired input devices and tethered tracking. Objects are recognized and tracked when placed on the display surface. By using multiple infrared light sources, the object's 3-D shape can be captured and inserted into the virtual interface. This ability permits spontaneity, since either preloaded objects or those objects selected at run-time by the user can become physical icons. Integrated into the same vision-based interface is the ability to identify 3-D hand position, pointing direction, and sweeping arm gestures. Such gestures can enhance selection, manipulation, and navigation tasks. The Perceptive Workbench has been used for a variety of applications, including augmented reality gaming and terrain navigation. This paper focuses on the techniques used in implementing the Perceptive Workbench and the system's performance.

Original languageEnglish (US)
Pages (from-to)59-71
Number of pages13
JournalMachine Vision and Applications
Volume14
Issue number1
DOIs
StatePublished - 2003

Keywords

  • 3-D object reconstruction
  • Computer vision
  • Gesture
  • Tracking
  • Virtual reality

ASJC Scopus subject areas

  • Software
  • Hardware and Architecture
  • Computer Vision and Pattern Recognition
  • Computer Science Applications

Fingerprint Dive into the research topics of 'The perceptive workbench: Computer-vision-based gesture tracking, object tracking, and 3D reconstruction for augmented desks'. Together they form a unique fingerprint.

  • Cite this