-
Noise Morphing for Audio Time Stretching
Authors:
Eloi Moliner,
Leonardo Fierro,
Alec Wright,
Matti Hämäläinen,
Vesa Välimäki
Abstract:
This letter introduces an innovative method to enhance the quality of audio time stretching by precisely decomposing a sound into sines, transients, and noise and by improving the processing of the latter component. While there are established methods for time-stretching sines and transients with high quality, the manipulation of noise or residual components has lacked robust solutions in prior re…
▽ More
This letter introduces an innovative method to enhance the quality of audio time stretching by precisely decomposing a sound into sines, transients, and noise and by improving the processing of the latter component. While there are established methods for time-stretching sines and transients with high quality, the manipulation of noise or residual components has lacked robust solutions in prior research. The proposed method combines sound decomposition with previous techniques for audio spectral resynthesis. The time-stretched noise component is achieved by morphing its time-interpolated spectral magnitude with a white-noise excitation signal. This method stands out for its simplicity, efficiency, and audio quality. The results of a subjective experiment affirm the superiority of this approach over current state-of-the-art methods across all evaluated stretch factors. The proposed technique notably excels in extreme stretching scenarios, signifying a substantial elevation in performance. The proposed method holds promise for a wide range of applications in slow-motion media content, such as music or sports video production.
△ Less
Submitted 22 December, 2023;
originally announced December 2023.
-
Online functional connectivity analysis of large all-to-all networks
Authors:
Lorenz Esch,
**long Dong,
Matti Hämäläinen,
Daniel Baumgarten,
Jens Haueisen,
Johannes Vorwerk
Abstract:
The analysis of EEG/MEG functional connectivity has become an important tool in neural research. Especially the high time resolution of EEG/MEG enables important insight into the functioning of the human brain. To date, functional connectivity is commonly estimated offline, i.e., after the conclusion of the experiment. However, online computation of functional connectivity has the potential to ena…
▽ More
The analysis of EEG/MEG functional connectivity has become an important tool in neural research. Especially the high time resolution of EEG/MEG enables important insight into the functioning of the human brain. To date, functional connectivity is commonly estimated offline, i.e., after the conclusion of the experiment. However, online computation of functional connectivity has the potential to enable unique experimental paradigms. For example, changes of functional connectivity due to learning processes could be tracked in real time and the experiment be adjusted based on these observations. Furthermore, the connectivity estimates can be used for neurofeedback applications or the instantaneous inspection of measurement results. In this study, we present the implementation and evaluation of online sensor and source space functional connectivity estimation in the open-source software MNE Scan. Online capable implementations of several functional connectivity metrics were established in the Connectivity library within MNE-CPP and made available as a plugin in MNE Scan. Online capability was achieved by enforcing multithreading and high efficiency for all computations, so that repeated computations were avoided wherever possible, which allows for a major speed-up in the case of overlap** intervalls. We present comprehensive performance evaluations of these implementations proving the online capability for the computation of large all-to-all functional connectivity networks. As a proof of principle, we demonstrate the feasibility of online functional connectivity estimation in the evaluation of somatosensory evoked brain activity.
△ Less
Submitted 6 March, 2023;
originally announced March 2023.
-
Extreme Audio Time Stretching Using Neural Synthesis
Authors:
Leonardo Fierro,
Alec Wright,
Vesa Välimäki,
Matti Hämäläinen
Abstract:
A deep neural network solution for time-scale modification (TSM) focused on large stretching factors is proposed, targeting environmental sounds. Traditional TSM artifacts such as transient smearing, loss of presence, and phasiness are heavily accentuated and cause poor audio quality when the TSM factor is four or larger. The weakness of established TSM methods, often based on a phase vocoder stru…
▽ More
A deep neural network solution for time-scale modification (TSM) focused on large stretching factors is proposed, targeting environmental sounds. Traditional TSM artifacts such as transient smearing, loss of presence, and phasiness are heavily accentuated and cause poor audio quality when the TSM factor is four or larger. The weakness of established TSM methods, often based on a phase vocoder structure, lies in the poor description and scaling of the transient and noise components, or nuances, of a sound. Our novel solution combines a sines-transients-noise decomposition with an independent WaveNet synthesizer to provide a better description of the noise component and an improve sound quality for large stretching factors. Results of a subjective listening test against four other TSM algorithms are reported, showing the proposed method to be often superior. The proposed method is stereo compatible and has a wide range of applications related to the slow motion of media content.
△ Less
Submitted 30 November, 2022;
originally announced November 2022.
