Vision-based articulated machine pose estimation for excavation monitoring and guidance

C. Feng, S. Dong, K. M. Lundeen, Y. Xiao, V. R. Kamat

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The pose of an articulated machine includes the position and orientation of not only the machine base (e.g., tracks or wheels), but also each of its major articulated components (e.g., stick and bucket). The ability to automatically estimate this pose is a crucial component of technical innovations aimed at improving both safety and productivity in many construction tasks. A computer vision based solution using a network of cameras and markers is proposed in this research to enable such a capability for articulated machines. Firstly, a planar marker is magnetically mounted on the end-effector of interest. Another marker is fixed on the jobsite whose 3D pose is pre-surveyed in a project coordinate frame. Then a cluster of at least two cameras respectively observing and tracking the two markers simultaneously forms a camera-marker network and transfers the end-effector's pose into the desired project frame, based on a pre-calibration of the relative poses between each pair of cameras. Through extensive sets of uncertainty analyses and field experiments, this approach is shown to be able to achieve centimeter level depth tracking accuracy within up to 15 meters with only two ordinary cameras (1.1 megapixel each) and a few markers, providing a flexible and cost-efficient alternative to other commercial products that use infrastructure dependent sensors like GPS. A working prototype has been tested on several active construction sites with positive feedback from excavator operators confirming the solution's effectiveness.

Original languageEnglish (US)
Title of host publication32nd International Symposium on Automation and Robotics in Construction and Mining
Subtitle of host publicationConnected to the Future, Proceedings
PublisherInternational Association for Automation and Robotics in Construction I.A.A.R.C)
ISBN (Electronic)9789517585972
DOIs
StatePublished - 2015
Event32nd International Symposium on Automation and Robotics in Construction and Mining: Connected to the Future, ISARC 2015 - Oulu, Finland
Duration: Jun 15 2015Jun 18 2015

Publication series

Name32nd International Symposium on Automation and Robotics in Construction and Mining: Connected to the Future, Proceedings

Other

Other32nd International Symposium on Automation and Robotics in Construction and Mining: Connected to the Future, ISARC 2015
CountryFinland
CityOulu
Period6/15/156/18/15

Keywords

  • Bundle adjustment
  • Camera-marker network
  • Excavation guidance
  • Pose estimation
  • Uncertainty analysis

ASJC Scopus subject areas

  • Building and Construction
  • Artificial Intelligence
  • Civil and Structural Engineering
  • Hardware and Architecture

Fingerprint Dive into the research topics of 'Vision-based articulated machine pose estimation for excavation monitoring and guidance'. Together they form a unique fingerprint.

  • Cite this

    Feng, C., Dong, S., Lundeen, K. M., Xiao, Y., & Kamat, V. R. (2015). Vision-based articulated machine pose estimation for excavation monitoring and guidance. In 32nd International Symposium on Automation and Robotics in Construction and Mining: Connected to the Future, Proceedings (32nd International Symposium on Automation and Robotics in Construction and Mining: Connected to the Future, Proceedings). International Association for Automation and Robotics in Construction I.A.A.R.C). https://doi.org/10.22260/isarc2015/0029