Multimodal immersive motion capture (MIMiC): A workflow for the musical performance

Cindy Bui, Andrea Genovese, Trey Bradley, Agnieszka Roginska

Research output: Contribution to conferencePaperpeer-review

Abstract

This paper introduces a workflow to record paired motion capture and sound of musical performances using an infrared light-based tracking system. This paper discusses example production cases ranging from short loops to full performances, addressing the production challenges and compromises, substantially different from a regular audio recording process. Motion capture is very versatile and can be applied in many disciplines including musical pedagogy, distributed performances, machine learning, and as creative assets. Paired audio-mocap data can be rendered into similar visual content for interactive virtual environments, live performances or fixed media. This extensible workflow can be adapted and extended for different purposes in musical performances to promote further research and creative content development.

Original languageEnglish (US)
StatePublished - 2020
Event149th Audio Engineering Society Convention 2020, AES 2020 - Virtual, Online
Duration: Oct 27 2020Oct 30 2020

Conference

Conference149th Audio Engineering Society Convention 2020, AES 2020
CityVirtual, Online
Period10/27/2010/30/20

ASJC Scopus subject areas

  • Modeling and Simulation
  • Acoustics and Ultrasonics

Fingerprint Dive into the research topics of 'Multimodal immersive motion capture (MIMiC): A workflow for the musical performance'. Together they form a unique fingerprint.

Cite this