TY - GEN
T1 - Developinimmersive VR experience for visualizing cross-cultural relationships in music
AU - Ganguli, Kaustuv Kanti
AU - Gomez, Oscar
AU - Kuzmenko, Leonid
AU - Guedes, Carlos
N1 - Publisher Copyright:
© 2020 IEEE.
PY - 2020/3
Y1 - 2020/3
N2 - With the advent in advanced computing methodologies and forward-thinking data storage needs over the last decade, there has been a major drive for reformatting archival collections to enable advanced computational analysis. In this paper, we present our digital compendium of music from the Arab Mashriq and Western Indian Ocean comprising two music collections drawn from Library materials and field recordings at the New York University Abu Dhabi. This is at once the product and object of our ongoing research at the intersection of cultural heritage preservation and computational analysis. Through computational-ethnomusicological research, we explore the cross-cultural similarities, interactions, and patterns from the music excerpts in order to understand their similarity space by employing audio analysis, machine learning, and visualization techniques. Besides the digital artifactual value, pedagogical/educational and scholarly outcomes, we focus on attracting user-friendly and community engagement into appreciating the music from this region. This is done by providing interactive visualizations of the musical features on a dashboard application and 3-D rendering of the mappings in a VR environment. The VR experience is not only immersive but also provides a scope for appreciation, learning, and dissemination of the music from the region.
AB - With the advent in advanced computing methodologies and forward-thinking data storage needs over the last decade, there has been a major drive for reformatting archival collections to enable advanced computational analysis. In this paper, we present our digital compendium of music from the Arab Mashriq and Western Indian Ocean comprising two music collections drawn from Library materials and field recordings at the New York University Abu Dhabi. This is at once the product and object of our ongoing research at the intersection of cultural heritage preservation and computational analysis. Through computational-ethnomusicological research, we explore the cross-cultural similarities, interactions, and patterns from the music excerpts in order to understand their similarity space by employing audio analysis, machine learning, and visualization techniques. Besides the digital artifactual value, pedagogical/educational and scholarly outcomes, we focus on attracting user-friendly and community engagement into appreciating the music from this region. This is done by providing interactive visualizations of the musical features on a dashboard application and 3-D rendering of the mappings in a VR environment. The VR experience is not only immersive but also provides a scope for appreciation, learning, and dissemination of the music from the region.
KW - Graphical user interfaces (GUI)
KW - H.5.2 [User Interfaces]: User Interfaces
KW - H.5.m [Information Interfaces and Presentation]: Miscellaneous
UR - http://www.scopus.com/inward/record.url?scp=85085359061&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85085359061&partnerID=8YFLogxK
U2 - 10.1109/VRW50115.2020.00086
DO - 10.1109/VRW50115.2020.00086
M3 - Conference contribution
AN - SCOPUS:85085359061
T3 - Proceedings - 2020 IEEE Conference on Virtual Reality and 3D User Interfaces, VRW 2020
SP - 401
EP - 406
BT - Proceedings - 2020 IEEE Conference on Virtual Reality and 3D User Interfaces, VRW 2020
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2020 IEEE Conference on Virtual Reality and 3D User Interfaces, VRW 2020
Y2 - 22 March 2020 through 26 March 2020
ER -