Developinimmersive VR experience for visualizing cross-cultural relationships in music

Kaustuv Kanti Ganguli, Oscar Gomez, Leonid Kuzmenko, Carlos Guedes

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

With the advent in advanced computing methodologies and forward-thinking data storage needs over the last decade, there has been a major drive for reformatting archival collections to enable advanced computational analysis. In this paper, we present our digital compendium of music from the Arab Mashriq and Western Indian Ocean comprising two music collections drawn from Library materials and field recordings at the New York University Abu Dhabi. This is at once the product and object of our ongoing research at the intersection of cultural heritage preservation and computational analysis. Through computational-ethnomusicological research, we explore the cross-cultural similarities, interactions, and patterns from the music excerpts in order to understand their similarity space by employing audio analysis, machine learning, and visualization techniques. Besides the digital artifactual value, pedagogical/educational and scholarly outcomes, we focus on attracting user-friendly and community engagement into appreciating the music from this region. This is done by providing interactive visualizations of the musical features on a dashboard application and 3-D rendering of the mappings in a VR environment. The VR experience is not only immersive but also provides a scope for appreciation, learning, and dissemination of the music from the region.

Original languageEnglish (US)
Title of host publicationProceedings - 2020 IEEE Conference on Virtual Reality and 3D User Interfaces, VRW 2020
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages401-406
Number of pages6
ISBN (Electronic)9781728165325
DOIs
StatePublished - Mar 2020
Event2020 IEEE Conference on Virtual Reality and 3D User Interfaces, VRW 2020 - Atlanta, United States
Duration: Mar 22 2020Mar 26 2020

Publication series

NameProceedings - 2020 IEEE Conference on Virtual Reality and 3D User Interfaces, VRW 2020

Conference

Conference2020 IEEE Conference on Virtual Reality and 3D User Interfaces, VRW 2020
Country/TerritoryUnited States
CityAtlanta
Period3/22/203/26/20

Keywords

  • Graphical user interfaces (GUI)
  • H.5.2 [User Interfaces]: User Interfaces
  • H.5.m [Information Interfaces and Presentation]: Miscellaneous

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Computer Science Applications
  • Human-Computer Interaction
  • Media Technology

Fingerprint

Dive into the research topics of 'Developinimmersive VR experience for visualizing cross-cultural relationships in music'. Together they form a unique fingerprint.

Cite this