Deploying Prerecorded Audio Description for Musical Theater Using Live Performance Tracking

Dirk Vander Wilt, Morwaread Mary Farbood

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Audio description, an accessibility service used by blind or visually impaired individuals, provides spoken descriptions of visual content. This alternative format allows those with low or no vision the ability to access information that sighted people obtain visually. In this paper a method for deploying prerecorded audio description in a live musical theater environment is presented. This method uses a reference audio recording and an online time warping algorithm to align tracks of audio description with live performances. A software implementation that is integrated into an existing theatrical workflow is also described. This system is used in two evaluation experiments that show the method successfully aligns multiple recordings of works of musical theater in order to automatically trigger prerecorded, descriptive audio in real time.

Original languageEnglish (US)
Title of host publicationPerception, Representations, Image, Sound, Music - 14th International Symposium, CMMR 2019, Revised Selected Papers
EditorsRichard Kronland-Martinet, Sølvi Ystad, Mitsuko Aramaki
PublisherSpringer Science and Business Media Deutschland GmbH
Pages181-189
Number of pages9
ISBN (Print)9783030702090
DOIs
StatePublished - 2021
Event14th International Symposium on Perception, Representations, Image, Sound, Music, CMMR 2019 - Marseille, France
Duration: Oct 14 2019Oct 18 2019

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume12631 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference14th International Symposium on Perception, Representations, Image, Sound, Music, CMMR 2019
Country/TerritoryFrance
CityMarseille
Period10/14/1910/18/19

Keywords

  • Accessibility
  • Audio description
  • Blind
  • Disability
  • Musical theater
  • Time warping
  • Visually impaired

ASJC Scopus subject areas

  • Theoretical Computer Science
  • General Computer Science

Fingerprint

Dive into the research topics of 'Deploying Prerecorded Audio Description for Musical Theater Using Live Performance Tracking'. Together they form a unique fingerprint.

Cite this