Sensor fusion for ecologically valid obstacle identification: Building a comprehensive assistive technology platform for the visually impaired

John Ross Rizzo, Yubo Pan, Todd Hudson, Edward K. Wong, Yi Fang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Sensor fusion represents a robust approach to ecologically valid obstacle identification in building a comprehensive electronic travel aid (ETA) for the blind and visually impaired. A stereoscopic camera system and an infrared sensor with 16 independent elements is proposed to be combined with a multi-scale convolutional neural network for this fusion framework. While object detection and identification can be combined with depth information from a stereo camera system, our experiments demonstrate that depth information may be inconsistent given material surfaces of specific potential collision hazards. This inconsistency can be easily remedied by supplementation with a more reliable depth signal from an alternate sensing modality. The sensing redundancy in this multi-modal strategy, as deployed in this platform, may enhance the situational awareness of a visually impaired end user, permitting more efficient and safer obstacle negotiation.

Original languageEnglish (US)
Title of host publication2017 7th International Conference on Modeling, Simulation, and Applied Optimization, ICMSAO 2017
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781509054541
DOIs
StatePublished - May 26 2017
Event7th International Conference on Modeling, Simulation, and Applied Optimization, ICMSAO 2017 - Sharjah, United Arab Emirates
Duration: Apr 4 2017Apr 6 2017

Publication series

Name2017 7th International Conference on Modeling, Simulation, and Applied Optimization, ICMSAO 2017

Other

Other7th International Conference on Modeling, Simulation, and Applied Optimization, ICMSAO 2017
CountryUnited Arab Emirates
CitySharjah
Period4/4/174/6/17

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Applied Mathematics
  • Control and Optimization
  • Modeling and Simulation

Fingerprint Dive into the research topics of 'Sensor fusion for ecologically valid obstacle identification: Building a comprehensive assistive technology platform for the visually impaired'. Together they form a unique fingerprint.

Cite this