Visual servoing of an inverted pendulum on cart using a mounted smartphone

Anthony Brill, Jared A. Frank, Vikram Kapila

Research output: Chapter in Book/Report/Conference proceedingConference contribution


Over the last several decades, visual servoing - A vision-based control approach-has been explored as a popular and inexpensive contactless measurement alternative for a variety of industrial robotic systems. Moreover, recent years have witnessed rapid advancements in mobile device applications that have pushed the envelope in the capabilities of smartphone cameras. In this paper, an eye-in-hand pose-based visual servoing (PBVS) approach is presented wherein a smartphone mounted to an inverted pendulum on cart (IPC) system measures both the translational position of a motorized cart and the angular orientation of a pendulum arm for the purpose of feedback control. To perform vision-based control of the IPC system, a discrete-time linear quadratic gaussian (LQG) controller is implemented. Experimental results are presented to characterize the relationships between the frame rate and image resolution of the smartphone camera, processing and wireless communication delays, the measurement noise, and the performance of the closed-loop system.

Original languageEnglish (US)
Title of host publication2016 American Control Conference, ACC 2016
PublisherInstitute of Electrical and Electronics Engineers Inc.
Number of pages6
ISBN (Electronic)9781467386821
StatePublished - Jul 28 2016
Event2016 American Control Conference, ACC 2016 - Boston, United States
Duration: Jul 6 2016Jul 8 2016

Publication series

NameProceedings of the American Control Conference
ISSN (Print)0743-1619


Other2016 American Control Conference, ACC 2016
Country/TerritoryUnited States

ASJC Scopus subject areas

  • Electrical and Electronic Engineering


Dive into the research topics of 'Visual servoing of an inverted pendulum on cart using a mounted smartphone'. Together they form a unique fingerprint.

Cite this