Evaluation of binaural renderers: Multidimensional sound quality assessment

Gregory Reardon, Andrea Genovese, Gabriel Zalles, Patrick Flanagan, Agnieszka Roginska

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

A multi-phase subjective experiment evaluating six commercially available binaural audio renderers was carried out. This paper presents the methodology, evaluation criteria, and main findings of the tests which assessed perceived sound quality of the renderers. Subjects appraised a number of specific sound quality attributes - timbral balance, clarity, naturalness, spaciousness, and dialogue intelligibility - and ranked, in terms of preference, the renderers for a set of music and movie stimuli presented over headphones. Results indicated that differences between the perceived quality and preference for a renderer are discernible. Binaural renderer performance was also found to be highly content-dependent, with significant interactions between renderers and individual stimuli being found, making it difficult to determine an "optimal" renderer for all settings.

Original languageEnglish (US)
Title of host publicationAES International Conference on Audio for Virtual and Augmented Reality 2018
Subtitle of host publicationScience, Technology, Design, and Implementation
PublisherAudio Engineering Society
Pages60-73
Number of pages14
Volume2018-August
ISBN (Electronic)9781510870390
StatePublished - Jan 1 2018
EventAES International Conference on Audio for Virtual and Augmented Reality: Science, Technology, Design, and Implementation, AVAR 2018 - Redmond, United States
Duration: Aug 20 2018Aug 22 2018

Other

OtherAES International Conference on Audio for Virtual and Augmented Reality: Science, Technology, Design, and Implementation, AVAR 2018
CountryUnited States
CityRedmond
Period8/20/188/22/18

Fingerprint

Acoustic waves
Headphones
stimuli
acoustics
evaluation
clarity
intelligibility
music
methodology
Experiments
interactions

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Acoustics and Ultrasonics

Cite this

Reardon, G., Genovese, A., Zalles, G., Flanagan, P., & Roginska, A. (2018). Evaluation of binaural renderers: Multidimensional sound quality assessment. In AES International Conference on Audio for Virtual and Augmented Reality 2018: Science, Technology, Design, and Implementation (Vol. 2018-August, pp. 60-73). Audio Engineering Society.

Evaluation of binaural renderers : Multidimensional sound quality assessment. / Reardon, Gregory; Genovese, Andrea; Zalles, Gabriel; Flanagan, Patrick; Roginska, Agnieszka.

AES International Conference on Audio for Virtual and Augmented Reality 2018: Science, Technology, Design, and Implementation. Vol. 2018-August Audio Engineering Society, 2018. p. 60-73.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Reardon, G, Genovese, A, Zalles, G, Flanagan, P & Roginska, A 2018, Evaluation of binaural renderers: Multidimensional sound quality assessment. in AES International Conference on Audio for Virtual and Augmented Reality 2018: Science, Technology, Design, and Implementation. vol. 2018-August, Audio Engineering Society, pp. 60-73, AES International Conference on Audio for Virtual and Augmented Reality: Science, Technology, Design, and Implementation, AVAR 2018, Redmond, United States, 8/20/18.
Reardon G, Genovese A, Zalles G, Flanagan P, Roginska A. Evaluation of binaural renderers: Multidimensional sound quality assessment. In AES International Conference on Audio for Virtual and Augmented Reality 2018: Science, Technology, Design, and Implementation. Vol. 2018-August. Audio Engineering Society. 2018. p. 60-73
Reardon, Gregory ; Genovese, Andrea ; Zalles, Gabriel ; Flanagan, Patrick ; Roginska, Agnieszka. / Evaluation of binaural renderers : Multidimensional sound quality assessment. AES International Conference on Audio for Virtual and Augmented Reality 2018: Science, Technology, Design, and Implementation. Vol. 2018-August Audio Engineering Society, 2018. pp. 60-73
@inproceedings{02772003c2b1472e9543ae6a87970f5a,
title = "Evaluation of binaural renderers: Multidimensional sound quality assessment",
abstract = "A multi-phase subjective experiment evaluating six commercially available binaural audio renderers was carried out. This paper presents the methodology, evaluation criteria, and main findings of the tests which assessed perceived sound quality of the renderers. Subjects appraised a number of specific sound quality attributes - timbral balance, clarity, naturalness, spaciousness, and dialogue intelligibility - and ranked, in terms of preference, the renderers for a set of music and movie stimuli presented over headphones. Results indicated that differences between the perceived quality and preference for a renderer are discernible. Binaural renderer performance was also found to be highly content-dependent, with significant interactions between renderers and individual stimuli being found, making it difficult to determine an {"}optimal{"} renderer for all settings.",
author = "Gregory Reardon and Andrea Genovese and Gabriel Zalles and Patrick Flanagan and Agnieszka Roginska",
year = "2018",
month = "1",
day = "1",
language = "English (US)",
volume = "2018-August",
pages = "60--73",
booktitle = "AES International Conference on Audio for Virtual and Augmented Reality 2018",
publisher = "Audio Engineering Society",
address = "United States",

}

TY - GEN

T1 - Evaluation of binaural renderers

T2 - Multidimensional sound quality assessment

AU - Reardon, Gregory

AU - Genovese, Andrea

AU - Zalles, Gabriel

AU - Flanagan, Patrick

AU - Roginska, Agnieszka

PY - 2018/1/1

Y1 - 2018/1/1

N2 - A multi-phase subjective experiment evaluating six commercially available binaural audio renderers was carried out. This paper presents the methodology, evaluation criteria, and main findings of the tests which assessed perceived sound quality of the renderers. Subjects appraised a number of specific sound quality attributes - timbral balance, clarity, naturalness, spaciousness, and dialogue intelligibility - and ranked, in terms of preference, the renderers for a set of music and movie stimuli presented over headphones. Results indicated that differences between the perceived quality and preference for a renderer are discernible. Binaural renderer performance was also found to be highly content-dependent, with significant interactions between renderers and individual stimuli being found, making it difficult to determine an "optimal" renderer for all settings.

AB - A multi-phase subjective experiment evaluating six commercially available binaural audio renderers was carried out. This paper presents the methodology, evaluation criteria, and main findings of the tests which assessed perceived sound quality of the renderers. Subjects appraised a number of specific sound quality attributes - timbral balance, clarity, naturalness, spaciousness, and dialogue intelligibility - and ranked, in terms of preference, the renderers for a set of music and movie stimuli presented over headphones. Results indicated that differences between the perceived quality and preference for a renderer are discernible. Binaural renderer performance was also found to be highly content-dependent, with significant interactions between renderers and individual stimuli being found, making it difficult to determine an "optimal" renderer for all settings.

UR - http://www.scopus.com/inward/record.url?scp=85056866438&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85056866438&partnerID=8YFLogxK

M3 - Conference contribution

VL - 2018-August

SP - 60

EP - 73

BT - AES International Conference on Audio for Virtual and Augmented Reality 2018

PB - Audio Engineering Society

ER -