Augmented Reality as a Medium for Human-Robot Collaborative Tasks

Sonia Mary Chacko, Vikram Kapila

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper presents a novel augmented reality (AR) interaction method that allows a robot to perform manipulation of unknown physical objects in a human-robot collaborative working environment. A mobile AR application is developed to determine and communicate, in real-time, the position, orientation, and dimension of any random object in a robot manipulator's workspace to perform pick-and-place operations. The proposed method is based on estimating the pose and size of the object by means of an AR virtual element superimposed on the live view of the real object. In particular, a semi-transparent AR element is created and manipulated through touch screen interactions to match with the pose and scale of the physical object to provide the information about that object. The resulting data is communicated to the robot manipulator to perform pick-and-place tasks. In this way, the AR virtual element acts as a medium of communication between a human and a robot. The performance of the proposed AR interface is assessed by conducting multiple trials with random objects, and it is observed that the robot successfully accomplishes tasks communicated through the AR virtual elements. The proposed interface is also tested with 20 users to determine the quality of user experience, followed by a poststudy survey. The participants reported that the AR interface is intuitive and easy to operate for manipulating physical objects of various sizes and shapes.

Original languageEnglish (US)
Title of host publication2019 28th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781728126227
DOIs
StatePublished - Oct 2019
Event28th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2019 - New Delhi, India
Duration: Oct 14 2019Oct 18 2019

Publication series

Name2019 28th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2019

Conference

Conference28th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2019
CountryIndia
CityNew Delhi
Period10/14/1910/18/19

ASJC Scopus subject areas

  • Artificial Intelligence
  • Human-Computer Interaction
  • Control and Optimization

Fingerprint Dive into the research topics of 'Augmented Reality as a Medium for Human-Robot Collaborative Tasks'. Together they form a unique fingerprint.

  • Cite this

    Chacko, S. M., & Kapila, V. (2019). Augmented Reality as a Medium for Human-Robot Collaborative Tasks. In 2019 28th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2019 [8956466] (2019 28th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2019). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/RO-MAN46459.2019.8956466