Dialog+ in Broadcasting: First Field Tests Using Deep-Learning-Based Dialogue Enhancement
Authors:
Matteo Torcoli,
Christian Simon,
Jouni Paulus,
Davide Straninger,
Alfred Riedel,
Volker Koch,
Stefan Wits,
Daniela Rieger,
Harald Fuchs,
Christian Uhle,
Stefan Meltzer,
Adrian Murtaza
Abstract:
Difficulties in following speech due to loud background sounds are common in broadcasting. Object-based audio, e.g., MPEG-H Audio solves this problem by providing a user-adjustable speech level. While object-based audio is gaining momentum, transitioning to it requires time and effort. Also, lots of content exists, produced and archived outside the object-based workflows. To address this, Fraunhof…
▽ More
Difficulties in following speech due to loud background sounds are common in broadcasting. Object-based audio, e.g., MPEG-H Audio solves this problem by providing a user-adjustable speech level. While object-based audio is gaining momentum, transitioning to it requires time and effort. Also, lots of content exists, produced and archived outside the object-based workflows. To address this, Fraunhofer IIS has developed a deep-learning solution called Dialog+, capable of enabling speech level personalization also for content with only the final audio tracks available. This paper reports on public field tests evaluating Dialog+, conducted together with Westdeutscher Rundfunk (WDR) and Bayerischer Rundfunk (BR), starting from September 2020. To our knowledge, these are the first large-scale tests of this kind. As part of one of these, a survey with more than 2,000 participants showed that 90% of the people above 60 years old have problems in understanding speech in TV "often" or "very often". Overall, 83% of the participants liked the possibility to switch to Dialog+, including those who do not normally struggle with speech intelligibility. Dialog+ introduces a clear benefit for the audience, filling the gap between object-based broadcasting and traditionally produced material.
△ Less
Submitted 17 December, 2021;
originally announced December 2021.
Dialogue Enhancement in Object-based Audio -- Evaluating the Benefit on People above 65
Authors:
Davide Straninger
Abstract:
Due to age-related hearing loss, elderly people often struggle with following the language on TV. Because they form an increasing part of the audience, this problem will become even more important in the future and needs to be addressed by research and development. Object-based audio is a promising approach to solve this issue as it offers the possibility of customizable dialogue enhancement (DE).…
▽ More
Due to age-related hearing loss, elderly people often struggle with following the language on TV. Because they form an increasing part of the audience, this problem will become even more important in the future and needs to be addressed by research and development. Object-based audio is a promising approach to solve this issue as it offers the possibility of customizable dialogue enhancement (DE). For this thesis an Adjustment / Satisfaction Test (A/ST) was conducted to evaluate the preferred loudness difference (LD) between speech and background in people above 65. Two different types of DE were tested: DE with separately available audio components (speech and background) and DE with components created by blind source separation (BSS). The preferred LDs compared to the original, differences of the preferred LDs between the two DE methods and the listener satisfaction were tested. It was observed that the preferred LDs were larger than the original LDs, that customizable DE increases listener satisfaction and that the two DE methods performed comparably well in terms of preferred LD and listener satisfaction. Based on the results, it can be assumed that elderly viewers above 65 will benefit equally from user-adjustable DE by available components and by dialogue separation.
△ Less
Submitted 25 June, 2020;
originally announced June 2020.
