Assessing Dynamic Balance in Virtual Reality: Sound Design and Implementation of the Audio System

This paper presents a novel multi-modality audio system designed for a virtual reality (VR) balance performance assessment application, examining how headphone and loudspeaker reproduction of auditory cues impacted dynamic balance and motor control in healthy young adults. Participants in the simulation were instructed to dodge incoming balls while reacting to various visual cues, facing cognitive challenges, and being exposed to different auditory conditions via headphones or loudspeakers. The experiment was divided into three parts, each incorporating various sound designs: synchronized foreground ball sounds, background distracting sounds, and directional notification sounds. These sounds were delivered through four modalities: Headphones, Loudspeakers, Room Simulation (headphones with room acoustic simulation), and Passthrough (loudspeakers with headphones worn). This paper provides a comprehensive description of the audio system’s architecture, technical implementation, and sound design choices. The findings offer valuable insights into designing audio systems for VR-based physical therapy and balance assessment, supporting the future development of applications ranging from user-friendly home setups to advanced clinical tools for analyzing and rehabilitating human movement and balance.