Audio quality evaluation by experienced and inexperienced listeners

Schinkel-Bielefeld N, Lotze N, Nagel F (2013)

Publication Type: Conference contribution

Publication year: 2013

Book Volume: 19

Conference Proceedings Title: Proceedings of Meetings on Acoustics

Event location: CAN

DOI: 10.1121/1.4799190

Abstract

Basic perceptual quality of coded audio material is commonly evaluated using ITU-R BS-1534 MUSHRA (Multi Stimulus with Hidden Reference and Anchors) listening tests. MUSHRA guidelines call for experienced listeners. However, the majority of consumers using the final product are no expert-listeners. Also the degree of expertise in a listening test may vary amongst listeners in the same laboratory. It would be useful to know how the audio quality evaluation differs between trained and untrained listeners and how training and actual tests should be designed in order to be as reliable as possible. To investigate the rating differences between experts and non-experts, we performed MUSHRA listening tests with 13 experienced and 11 inexperienced listeners using 5 speech and audio codecs delivering a wide range of basic audio quality. Except for the hidden reference, absolute ratings of non-experts were consistently higher than those of experts. However, rank order only rarely changed between experts and non-experts. For lower quality values, confidence intervals were significantly larger for non-experts than for experts. Experienced listeners set more than twice as many loops as non-experts, compared more often between codecs and listened to high quality codecs for a longer duration than non-experts. © 2013 Acoustical Society of America.

Authors with CRIS profile

Frederik Nagel Professur für Human Centered Data Science

Involved external institutions

Fraunhofer-Institut für Integrierte Schaltungen (IIS) DE Germany (DE)

How to cite

APA:

Schinkel-Bielefeld, N., Lotze, N., & Nagel, F. (2013). Audio quality evaluation by experienced and inexperienced listeners. In Proceedings of Meetings on Acoustics. CAN.

MLA:

Schinkel-Bielefeld, Nadja, Netaya Lotze, and Frederik Nagel. "Audio quality evaluation by experienced and inexperienced listeners." Proceedings of the 21st International Congress on Acoustics, ICA 2013 - 165th Meeting of the Acoustical Society of America, CAN 2013.

BibTeX: Download