October 2024 - Kommunikationstechnik-Kolloquium

Communication Technology Colloquium at IKS
by Simone Sedgwick 19 May '25

19 May '25

Dear subscribers of the colloquium newsletter, we are happy to inform you about the next date of our Communication Technology Colloquium. *Wednesday, January 18, 2022* *Speaker*: Konstantin Wehmeyer *Time:* 2:00 p.m. *Location*: hybrid - Lecture room 4G and https://rwth.zoom.us/j/97904157921?pwd=SWpsbDl0MWhrWjY1ZkZaeFRoYmErZz09 Meeting-ID: 979 0415 7921 Passwort: 481650 *Bachelor-Lecture: ***Deep Learning-Based Speech Synthesis as Post-Processing of a Noise Reduction /Audio and speech signals are often disturbed by noise signals in frequency- and/or time-limited parts. To attenuate or remove these distortions, several methods, including deep learning- based approaches, are known. Often, however, only the magnitude spectrum is processed and the phase spectrum is taken over unchanged due to its comparatively lower relevance. Consequently, the noisy phase is reused when synthesizing the waveform from the processed magnitude spectrum. Therefore, distortions in the magnitude spectrum can be reduced, but not in the phase spectrum which inevitably leads to a deterioration in speech quality and intelligibility./ /This thesis presents methods that allow a reconstruction of the phase spectrum of speech signals based on noise-reduced magnitude spectra. At the Institute of Communication Systems at RWTH Aachen University a phase reconstruction algorithm was developed and this algorithm has already been evaluated in a previous study for the case of smoothed magnitude spectra. It was shown that the deep neural network (DNN) used can benefit from targeted training on the smoothed magnitude spectra even without further modification of the network structures. However, even slight smearing of the magnitude spectra already leads to a significant loss in performance compared to the use of perfect magnitude spectra. In this work, therefore, the DNNs used are optimized for the case of noise-reduced magnitude spectra. // / /Several deep learning-based models are introduced and compared with each other and with the models already developed. Their properties and aspects such as causality are addressed. Moreover, a new loss function and assessment measure specifically designed to estimate and assess the phase spectrum of speech signals is developed and tested. In order to be able to evaluate the results as independently as possible of a specific type of noise reduction, ideal masks are developed, used, and discussed. / All interested parties are cordially invited, registration is not required. General information on the colloquium, as well as a current list of dates of the Communication Technology Colloquium can be found at: https://www.iks.rwth-aachen.de/aktuelles/kolloquium -- Simone Sedgwick Institute of Communication Systems(IKS) Prof. Dr.-Ing. Peter Jax RWTH Aachen University Muffeter Weg 3a, 52074 Aachen, Germany +49 241 80 26956(phone) +49 241 80 22254(fax) sedgwick(a)iks.rwth-aachen.de https://www.iks.rwth-aachen.de/

1 10

Kommunikationstechnisches Kolloquium am IKS
by Simone Sedgwick 30 Apr '25

30 Apr '25

Sehr geehrte Abonnenten des Kolloquium-Newsletters, gerne informieren wir Sie über den nächsten Termin unseres Kommunikationstechnischen Kolloquiums. *Freitag, 20. Oktober 2023* *Vortragender:* Kenan Linden *Zeit*: 12:00 Uhr *Ort*: hybrid - Hörsaal 4G und https://rwth.zoom.us/j/61215027648?pwd=MTJvayt5bkdka04raWZVempPZGE0Zz09 Meeting ID: 612 1502 7648 Passcode: 380386 *Bachelor-Vortrag:* */*Untersuchungen zur Interaktion von Feedforward- und Feedback-Regelung bei aktiver Störgeräuschkompensation in Kopfhörern*/* Für das Erstellen eines aktiven störgeräuschkompensierenden Systems (“ANC“) für Kopfhörer werden hauptsächlich die Ansätze eines Feedforward-System, eines Feedback-System oder einer Kombination der beiden, eines Hybrid-Systems verwendet. In dieser Arbeit werden Verfahren zum optimalen Entwurf eines Feedforward-Filters für die Integration in ein Hybrid-ANC-System vorgestellt und verglichen. Dabei werden weitere Variationen des Filters untersucht, mit dem Hintergrund, das Filter für realistische Anwen- dungen weiter zu optimieren. Um die Wichtigkeit bestimmter Frequenzen beim Erstellen des Filters hervorzuheben, wird eine Gewichtung eingeführt. Für das Entwerfen eines solchen Gewichts, wurde eine Messung durchgeführt, in welcher vier mögliche Eingangssignale zu einem Gewicht zusammengefasst wurden. Des Weiteren wurden zwei verschiedene variierende Feedback-Systeme und ihr Effekt auf das Hybrid-ANC-System genauer untersucht. Insgesamt wurden mit dem vorgestellten Hybrid-ANC-System eine deutliche Verbesserung in der Dämpfungen gegenüber dem verglichenen Feedforward-System erreicht. Mithilfe der eingeführten Gewichtung konnte das Filter eines Hybrid-Systems noch weiter für reale Anwen- dungen optimiert werden. Dabei stellte sich heraus, dass das Feedback-System komplett von einer geschickt gewählten Gewichtung kompensiert werden konnte, woraus sich entnehmen ließ, dass ein Hybrid-System auch unabhängig von einem Feedback-System ausgelegt werden kann, wenn die Gewichtung entsprechend gewählt wird. Zuletzt konnte beim Untersuchen des Feedback-Anteils für ein Hybrid-System gezeigt werden, dass das Hybrid-Filter, auch wenn es für den okklusions Effekt (“OE“) oder variante Feedback-Filter ausgelegt wird, deutlich bessere Ergebnisse verspricht als das Feedforward-System. Alle Interessierten sind herzlich eingeladen, eine Anmeldung ist nicht erforderlich. Allgemeine Informationen zum Kolloquium, sowie eine aktuelle Liste der Termine des Kommunikationstechnischen Kolloquiums finden Sie unter: http://www.iks.rwth-aachen.de/aktuelles/kolloquium -- Simone Sedgwick Secretariat Institute of Communication Systems(IKS) Prof. Dr.-Ing. Peter Jax RWTH Aachen University Muffeter Weg 3a, 52074 Aachen, Germany +49 241 80 26956(phone) +49 241 80 22254(fax) sedgwick(a)iks.rwth-aachen.de https://www.iks.rwth-aachen.de/

1 3

Communication Technology Colloquium at IKS - Einladung Promotionsvortrag
by Anett Schindler 29 Oct '24

29 Oct '24

Dear subscribers of the colloquium newsletter, we are happy to inform you about the next date of our Communication Technology Colloquium. *Thursday, November 14, 2024* *Speaker*: Sebastian Nagel, M. Sc. *Topic*: Interactive Reproduction of Binaurally Recorded Signals *Time:* 11:30 a.m. *Location*: hybrid - Lecture room 4G *Online*: https://rwth.zoom.us/j/61215027648?pwd=MTJvayt5bkdka04raWZVempPZGE0Zz09 Meeting-ID: 612 1502 7648 Passwort: 380386 Abstract of the Dissertation *Interactive Reproduction of Binaurally Recorded Signals * by Sebastian Nagel, M.Sc. Motivation, Goal, and Task of this Dissertation The goal of acoustic augmented or virtual reality is to artificially invoke a realistic auditory impression in the listener. One technique to achieve this goal is /binaural reproduction/, which refers to the reproduction of certain audio signals at the two ears of the listener. The ear signals can be obtained by /binaural recording/ or /binaural rendering/, that is, by spatially sampling a real or virtual sound field with two microphones, one at each ear of a recording head. Such signals are referred to as /binaurally recorded signals/ in the following. For a moving listener to perceive sound sources as fixed in the environment, the reproduced signals need to match the listener’s movements. State-of-the-art methods for this /interactive binaural reproduction/ generate such signals based on denser spatial samplings of sound fields (i.e., more than two microphones), or they perform real-time binaural rendering. The goal of this thesis is to achieve interactive binaural reproduction based on binaurally recorded signals, that is, on two ear signals originally intended for non-interactive binaural reproduction for a non-moving listener. This is desirable for two major reasons. It makes binaural recordings usable for immersive playback. This potentially improves the user experience in applications such as telecommunications, or for consumer-generated content, where greater technical effort for recording may not be feasible. Furthermore, the resulting methods seamlessly interoperate with established technologies. Technically, binaurally recorded signals are ordinary stereo signals, and their spatial relationships are defined by human anatomy. This eliminates the coordination and standardization efforts that would be required to make the state-of-the-art methods widely usable. The task of this dissertation is to develop algorithms that interact with a complex biological system (the human auditory system). The ultimate evaluation criterion is the subjective quality of the listening experience to the human listener, which can only be assessed through listening experiments. Therefore, to validate the result, a listening experiment is presented at the end of the dissertation. Before that, algorithms are developed and evaluated on a theoretical basis. Derivations are based on signal models, and evaluations are based on the interpretation of signal properties, both of which are rooted in knowledge of human auditory perception. Major Scientific Contributions The model-based algorithms are developed in two steps. First, binaurally recorded signals with only coherent sound from a single sound source are regarded. The derived algorithms act as a time-variant filter to modify the spatial properties of the binaurally recorded signals. The filter is parameterized with the measured listener head motion and the source direction estimated from the recorded signals. This novel principle allows the listener to perceive the source in a stable position in the environment. It was first proposed by the author in [NJ18], and it has been patented [NJ23]. This dissertation provides analyses of different filter design methods and architectures. The subjective quality of the first algorithms is not suitable for signals which violate the model assumption of only direct sound, such as reverberant signals. Therefore, signals with a mix of coherent and incoherent sound are regarded in the second step. The derived algorithms perform a coherence-adaptive trade-off between the spatial modification of the coherent sound and the preservation of incoherent sound [NHJ20]. Their performance is theoretically limited by the limited ability of linear spatial filters to separate coherent and incoherent signal components [NJ21]. This dissertation provides a thorough analysis of the theoretical limitations. It also proposes perceptually motivated improvements to the filter structure that significantly extend the theoretical limits. Finally, this dissertation presents a listening experiment to validate the proposed method. Acoustic scenes with speech sources were binaurally recorded at the ears of human test subjects. A real-time prototype with head tracking provided interactive binaural reproduction of these recordings via headphones. Subjects were asked to distinguish, in an indirect comparison, the artificial binaural reproduction from reality (ground-truth signals emitted by the loudspeakers in the same room). Results show that this task was difficult even for expert listeners, indicating that the method provides a natural and plausible listening experience. Major Publications [NJ18] S. Nagel and P. Jax, “Dynamic Binaural Cue Adaptation,” in Proceedings of International Workshop on Acoustic Signal Enhancement (IWAENC), September 2018. [NHJ20] S. Nagel, D. Haupt, and P. Jax, “Coherence-Adaptive Binaural Cue Adaptation,” inProceedings of International Conference on Audio for Virtual and Augmented Reality (AVAR), August 2020. [NJ21] S. Nagel and P. Jax, “On the Use of Additional Microphones in Binaural Cue Adaptation,” in Proceedings of ITG Conference on Speech Communication, September 2021. [NJ23] S. Nagel and P. Jax, “Methods for obtaining and reproducing a binaural recording,” U.S. patent, US 11,546,703 B2, January 2023. All interested parties are cordially invited, registration is not required. General information on the colloquium, as well as a current list of dates of the Communication Technology Colloquium can be found at: https://www.iks.rwth-aachen.de/aktuelles/kolloquium Best regards Anett Schindler *Anett Schindler* Institute of Communication Systems (IKS) RWTH Aachen University Muffeter Weg 3a, 52074 Aachen, Germany +49 241 80 26958 schindler(a)iks.rwth-aachen.de https://www.iks.rwth-aachen.de/

1 0

Communication Technology Colloquium at IKS
by Anett Schindler 08 Oct '24

08 Oct '24

Dear subscribers of the colloquium newsletter, we are happy to inform you about the next date of our Communication Technology Colloquium. *Monday, October 14, 2024* *Speaker*: Johannes Hahn *Time:* 14:00 pm *Location*: hybrid - Lecture room 4G and https://rwth.zoom.us/j/61215027648?pwd=MTJvayt5bkdka04raWZVempPZGE0Zz09 Meeting-ID: 612 1502 7648 Passwort: 380386 *Master-Lecture: ** * */*Identification of Time-Variant MIMO Systems using Acoustic Manifolds*/* Many applications in digital signal processing such as Acoustic Echo Cancellation (AEC) and adaptive Crosstalk Cancellation (CTC) rely on methods of Acoustic System Identification (ASI), which aims at determining the impulse responses between loudspeakers and microphones in a given acoustic enclosure. This task is particularly challenging if multiple inputs and outputs have to be considered, leading to a large number of parameters to be identified. The complexity increases further if the system and thus the parameters are time-varying. Moreover, such Multiple Inputs Multiple Outputs (MIMO) systems suffer from the non-uniqueness problem, which impairs the performance of established ASI methods. To overcome these challenges, recent developments focus on the incorporation of prior knowledge into the system identification. In this context, several approaches take advantage of the manifold hypothesis. It states that the Room Impulse Responses (RIRs) in a given MIMO scenario can be modeled by a low-dimensional representation lying on or close to a usually nonlinear manifold, which can be learned a-priori or estimated online. This thesis investigates a novel approach to the identification of time-variant MIMO systems which exploits the manifold hypothesis to greatly reduce the number of tracked parameters. A Variational Auto-Encoder (VAE) is trained to learn the manifold in terms of a low-dimensional coordinate representation. During ASI, only this representation is tracked, using an Extended Kalman Filter (EKF). As a result, less time-variant parameters have to be identified. Additionally, measurements are conducted using an artificial head and two loudspeakers to create a data set of real-world RIRs, and test sequences are recorded that facilitate the evaluation of ASI algorithms in a real-world scenario. In an extensive parameter study, the architecture and hyperparameters of the VAE are investigated and tuned. A validation of the proposed method in simulated scenarios as well as on the test recordings showcases its superiority in the identification of time-varying systems and its robustness towards the non-uniqueness problem in comparison to established ASI methods and related approaches built on the manifold hypothesis. All interested parties are cordially invited, registration is not required. General information on the colloquium, as well as a current list of dates of the Communication Technology Colloquium can be found at: https://www.iks.rwth-aachen.de/aktuelles/kolloquium Anett Schindler Institute of Communication Systems(IKS) Prof. Dr.-Ing. Peter Jax RWTH Aachen University Muffeter Weg 3a, 52074 Aachen, Germany <https://www.google.com/maps/search/Muffeter+Weg+3a,+52074+Aachen,+Germany?e…> +49 241 80 26958(phone) +49 241 80 22254(fax) schindler <mailto:sedgwick@iks.rwth-aachen.de>@iks.rwth-aachen.de <mailto:sedgwick@iks.rwth-aachen.de> https://www.iks.rwth-aachen.de/

1 0

Communication Technology Colloquium at IKS
by Anett Schindler 07 Oct '24

07 Oct '24

Dear subscribers of the colloquium newsletter, we are happy to inform you about the next date of our Communication Technology Colloquium. *Friday, October 11, 2024* *Speaker*: Lea Brehm *Time:* 11:00 am *Location*: hybrid - Lecture room 4G and https://rwth.zoom.us/j/61215027648?pwd=MTJvayt5bkdka04raWZVempPZGE0Zz09 Meeting-ID: 612 1502 7648 Passwort: 380386 *Bachelor-Lecture: ** * */*Evaluation of Sound Source Localization Algorithms with Recorded Binaural Signals*/* /The localization of binaural sound sources is essential for various modern applications. While most algorithms struggle with dynamic situations caused by the movement of the head, the movement invariant beamforming binaural direction of arrival estimator (MIBF DoA estimator) involves the information on head rotations. This algorithm applies the motion information to a target beamforming direction-of-arrival (DoA) estimator in order to identify the position of a sound source on the horizontal plane in dynamic situations./ /This thesis implements an extension of this algorithms to three dimensions, achieved by the usage of quaternions for the MIBF DoA estimator. We evaluate the algorithm based on simulations and data from an experimental set up. The results demonstrate that the algorithm identifies sound source positions in the three dimensional space correctly, especially during the movement of the head around multiple rotation axes. Furthermore, the utilization of head motions resolves problems caused by an ambiguous interaural time difference (ITD) and interaural level difference (ILD)./ / / All interested parties are cordially invited, registration is not required. General information on the colloquium, as well as a current list of dates of the Communication Technology Colloquium can be found at: https://www.iks.rwth-aachen.de/aktuelles/kolloquium Anett Schindler Institute of Communication Systems(IKS) Prof. Dr.-Ing. Peter Jax RWTH Aachen University Muffeter Weg 3a, 52074 Aachen, Germany <https://www.google.com/maps/search/Muffeter+Weg+3a,+52074+Aachen,+Germany?e…> +49 241 80 26958(phone) +49 241 80 22254(fax) schindler <mailto:sedgwick@iks.rwth-aachen.de>@iks.rwth-aachen.de <mailto:sedgwick@iks.rwth-aachen.de> https://www.iks.rwth-aachen.de/

1 0