Showing 1–50 of 67 results for author: Balázs, P

Injectivity of ReLU-layers: Perspectives from Frame Theory

Authors: Daniel Haider, Martin Ehler, Peter Balazs

Abstract: Injectivity is the defining property of a map** that ensures no information is lost and any input can be perfectly reconstructed from its output. By performing hard thresholding, the ReLU function naturally interferes with this property, making the injectivity analysis of ReLU-layers in neural networks a challenging yet intriguing task that has not yet been fully solved. This article establishes… ▽ More Injectivity is the defining property of a map** that ensures no information is lost and any input can be perfectly reconstructed from its output. By performing hard thresholding, the ReLU function naturally interferes with this property, making the injectivity analysis of ReLU-layers in neural networks a challenging yet intriguing task that has not yet been fully solved. This article establishes a frame theoretic perspective to approach this problem. The main objective is to develop the most general characterization of the injectivity behavior of ReLU-layers in terms of all three involved ingredients: (i) the weights, (ii) the bias, and (iii) the domain where the data is drawn from. Maintaining a focus on practical applications, we limit our attention to bounded domains and present two methods for numerically approximating a maximal bias for given weights and data domains. These methods provide sufficient conditions for the injectivity of a ReLU-layer on those domains and yield a novel practical methodology for studying the information loss in ReLU layers. Finally, we derive explicit reconstruction formulas based on the duality concept from frame theory. △ Less

Submitted 22 June, 2024; originally announced June 2024.

Kernel theorems for operators on co-orbit spaces associated with localised frames

Authors: Dimitri Bytchenkoff, Michael Speckbacher, Peter Balazs

Abstract: Kernel theorems, in general, provide a convenient representation of bounded linear operators. For the operator acting on a concrete function space, this means that its action on any element of the space can be expressed as a generalised integral operator, in a way reminiscent of the matrix representation of linear operators acting on finite dimensional vector spaces. We prove kernel theorems for b… ▽ More Kernel theorems, in general, provide a convenient representation of bounded linear operators. For the operator acting on a concrete function space, this means that its action on any element of the space can be expressed as a generalised integral operator, in a way reminiscent of the matrix representation of linear operators acting on finite dimensional vector spaces. We prove kernel theorems for bounded linear operators acting on co-orbit spaces associated with localised frames. Our two main results consist in characterising the spaces of operators whose generalised integral kernels belong to the co-orbit spaces of test functions and distributions associated with the tensor product of the localised frames respectively. Moreover, using a version of Schur's test, we establish a characterisation of the bounded linear operators between some specific co-orbit spaces. △ Less

Submitted 21 May, 2024; v1 submitted 28 February, 2024; originally announced February 2024.

MSC Class: 42B35; 42C15; 46A32; 47B34

Weighted frames, weighted lower semi frames and unconditionally convergent multipliers

Authors: Peter Balazs, Rosario Corso, Diana Stoeva

Abstract: In this paper we ask when it is possible to transform a given sequence into a frame or a lower semi frame by multiplying the elements by numbers. In other words, we ask when a given sequence is a weighted frame or a weighted lower semi frame and for each case we formulate a conjecture. We determine several conditions under which these conjectures are true. Finally, we prove an equivalence between… ▽ More In this paper we ask when it is possible to transform a given sequence into a frame or a lower semi frame by multiplying the elements by numbers. In other words, we ask when a given sequence is a weighted frame or a weighted lower semi frame and for each case we formulate a conjecture. We determine several conditions under which these conjectures are true. Finally, we prove an equivalence between two older conjectures, the first one being that any unconditionally convergent multiplier can be written as a multiplier of Bessel sequences by shifting of weights, and the second one that every unconditionally convergent multiplier which is invertible can be written as a multiplier of frames by shifting of weights. We also show that these conjectures are also related to one of the newly posed conjectures. △ Less

Submitted 29 October, 2023; originally announced October 2023.

Comments: 14 pages

An unbounded operator theory approach to lower frame and Riesz-Fischer sequences

Authors: Peter Balazs, Mitra Shamsabadi

Abstract: Frames and orthonormal bases are naturally linked to bounded operators. To tackle unbounded operators those sequences might not be well suited. This has already been noted by von Neumann in the 1920ies. But modern frame theory also investigates other sequences, including those that are not naturally linked to bounded operators. The focus of this manuscript will be two such kind of sequences: lower… ▽ More Frames and orthonormal bases are naturally linked to bounded operators. To tackle unbounded operators those sequences might not be well suited. This has already been noted by von Neumann in the 1920ies. But modern frame theory also investigates other sequences, including those that are not naturally linked to bounded operators. The focus of this manuscript will be two such kind of sequences: lower frame and Riesz-Fischer sequences. We will discuss the inter-relation of those sequences. We will fill a hole existing in the literature regarding the classification of those sequences by their synthesis operator. We will use the idea of generalized frame operator and Gram matrix and extend it. We will use that to show properties for canonical duals for lower frame sequences, like e.g. a minimality condition regarding its coefficients. We will also show that other results that are known for frames can be generalized to lower frame sequences. To be able to tackle these tasks, we had to revisit the concept of invertibility (in particular for non-closed operators). In addition, we are able to define a particular adjoint, which is uniquely defined for any operator. △ Less

Submitted 3 October, 2023; originally announced October 2023.

Instabilities in Convnets for Raw Audio

Authors: Daniel Haider, Vincent Lostanlen, Martin Ehler, Peter Balazs

Abstract: What makes waveform-based deep learning so hard? Despite numerous attempts at training convolutional neural networks (convnets) for filterbank design, they often fail to outperform hand-crafted baselines. These baselines are linear time-invariant systems: as such, they can be approximated by convnets with wide receptive fields. Yet, in practice, gradient-based optimization leads to suboptimal appr… ▽ More What makes waveform-based deep learning so hard? Despite numerous attempts at training convolutional neural networks (convnets) for filterbank design, they often fail to outperform hand-crafted baselines. These baselines are linear time-invariant systems: as such, they can be approximated by convnets with wide receptive fields. Yet, in practice, gradient-based optimization leads to suboptimal approximations. In our article, we approach this phenomenon from the perspective of initialization. We present a theory of large deviations for the energy response of FIR filterbanks with random Gaussian weights. We find that deviations worsen for large filters and locally periodic input signals, which are both typical for audio signal processing applications. Numerical simulations align with our theory and suggest that the condition number of a convolutional layer follows a logarithmic scaling law between the number and length of the filters, which is reminiscent of discrete wavelet bases. △ Less

Submitted 26 April, 2024; v1 submitted 11 September, 2023; originally announced September 2023.

Comments: 4 pages, 5 figures, 1 page appendix with mathematical proofs

Journal ref: IEEE Signal Processing Letters 31 (2024) 1084-1088

Fitting Auditory Filterbanks with Multiresolution Neural Networks

Authors: Vincent Lostanlen, Daniel Haider, Han Han, Mathieu Lagrange, Peter Balazs, Martin Ehler

Abstract: Waveform-based deep learning faces a dilemma between nonparametric and parametric approaches. On one hand, convolutional neural networks (convnets) may approximate any linear time-invariant system; yet, in practice, their frequency responses become more irregular as their receptive fields grow. On the other hand, a parametric model such as LEAF is guaranteed to yield Gabor filters, hence an optima… ▽ More Waveform-based deep learning faces a dilemma between nonparametric and parametric approaches. On one hand, convolutional neural networks (convnets) may approximate any linear time-invariant system; yet, in practice, their frequency responses become more irregular as their receptive fields grow. On the other hand, a parametric model such as LEAF is guaranteed to yield Gabor filters, hence an optimal time-frequency localization; yet, this strong inductive bias comes at the detriment of representational capacity. In this paper, we aim to overcome this dilemma by introducing a neural audio model, named multiresolution neural network (MuReNN). The key idea behind MuReNN is to train separate convolutional operators over the octave subbands of a discrete wavelet transform (DWT). Since the scale of DWT atoms grows exponentially between octaves, the receptive fields of the subsequent learnable convolutions in MuReNN are dilated accordingly. For a given real-world dataset, we fit the magnitude response of MuReNN to that of a well-established auditory filterbank: Gammatone for speech, CQT for music, and third-octave for urban sounds, respectively. This is a form of knowledge distillation (KD), in which the filterbank ''teacher'' is engineered by domain knowledge while the neural network ''student'' is optimized from data. We compare MuReNN to the state of the art in terms of goodness of fit after KD on a hold-out set and in terms of Heisenberg time-frequency localization. Compared to convnets and Gabor convolutions, we find that MuReNN reaches state-of-the-art performance on all three optimization problems. △ Less

Submitted 25 July, 2023; originally announced July 2023.

Comments: 4 pages, 4 figures, 1 table, conference

Journal ref: 2023 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA 2023)

Autonomous neural information processing by a dynamical memristor circuit

Authors: Dániel Molnár, Tímea Nóra Török, Roland Kövecs, László Pósa, Péter Balázs, György Molnár, Nadia Jimenez Olalla, Juerg Leuthold, János Volk, Miklós Csontos, András Halbritter

Abstract: Analog tunable memristors are widely utilized as artificial synapses in various neural network applications. However, exploiting the dynamical aspects of their conductance change to implement active neurons is still in its infancy, awaiting the realization of efficient neural signal recognition functionalities. Here we experimentally demonstrate an artificial neural information processing unit tha… ▽ More Analog tunable memristors are widely utilized as artificial synapses in various neural network applications. However, exploiting the dynamical aspects of their conductance change to implement active neurons is still in its infancy, awaiting the realization of efficient neural signal recognition functionalities. Here we experimentally demonstrate an artificial neural information processing unit that can detect a temporal pattern in a very noisy environment, fire a single output spike upon successful detection and reset itself in a fully unsupervised, autonomous manner. This circuit relies on the dynamical operation of only two memristive blocks: a non-volatile Ta$_2$O$_5$ device and a volatile VO$_2$ unit. A fading functionality with exponentially tunable memory time constant enables adaptive operation dynamics, which can be tailored for the targeted temporal pattern recognition task. In the trained circuit false input patterns only induce short-term variations. In contrast, the desired signal activates long-term memory operation of the non-volatile component, which triggers a firing output of the volatile block. △ Less

Submitted 25 July, 2023; originally announced July 2023.

Comments: 11 pages, 6 figures

Convex Geometry of ReLU-layers, Injectivity on the Ball and Local Reconstruction

Authors: Daniel Haider, Martin Ehler, Peter Balazs

Abstract: The paper uses a frame-theoretic setting to study the injectivity of a ReLU-layer on the closed ball of $\mathbb{R}^n$ and its non-negative part. In particular, the interplay between the radius of the ball and the bias vector is emphasized. Together with a perspective from convex geometry, this leads to a computationally feasible method of verifying the injectivity of a ReLU-layer under reasonable… ▽ More The paper uses a frame-theoretic setting to study the injectivity of a ReLU-layer on the closed ball of $\mathbb{R}^n$ and its non-negative part. In particular, the interplay between the radius of the ball and the bias vector is emphasized. Together with a perspective from convex geometry, this leads to a computationally feasible method of verifying the injectivity of a ReLU-layer under reasonable restrictions in terms of an upper bound of the bias vector. Explicit reconstruction formulas are provided, inspired by the duality concept from frame theory. All this gives rise to the possibility of quantifying the invertibility of a ReLU-layer and a concrete reconstruction algorithm for any input vector on the ball. △ Less

Submitted 18 July, 2023; originally announced July 2023.

Comments: 10 pages main paper + 2 pages appendix, 4 figures, 2 algorithms, conference

Journal ref: International Conference on Machine Learning 2023

Accelerated Griffin-Lim algorithm: A fast and provably converging numerical method for phase retrieval

Authors: Rossen Nenov, Dang-Khoa Nguyen, Peter Balazs, Radu Ioan Bot

Abstract: The recovery of a signal from the magnitudes of its transformation, like the Fourier transform, is known as the phase retrieval problem and is of big relevance in various fields of engineering and applied physics. In this paper, we present a fast inertial/momentum based algorithm for the phase retrieval problem and we prove a convergence guarantee for the new algorithm and for the Fast Griffin-Lim… ▽ More The recovery of a signal from the magnitudes of its transformation, like the Fourier transform, is known as the phase retrieval problem and is of big relevance in various fields of engineering and applied physics. In this paper, we present a fast inertial/momentum based algorithm for the phase retrieval problem and we prove a convergence guarantee for the new algorithm and for the Fast Griffin-Lim algorithm, whose convergence remained unproven in the past decade. In the final chapter, we compare the algorithm for the Short Time Fourier transform phase retrieval with the Griffin-Lim algorithm and FGLA and to other iterative algorithms typically used for this type of problem. △ Less

Submitted 21 June, 2023; originally announced June 2023.

Faster than Fast: Accelerating the Griffin-Lim Algorithm

Authors: Rossen Nenov, Dang-Khoa Nguyen, Peter Balazs

Abstract: The phase retrieval problem is found in various areas of applications of engineering and applied physics. It is also a very active field of research in mathematics, signal processing and machine learning. In this paper, we present an accelerated version of the well known Fast Griffin-Lim algorithm (FGLA) for the phase retrieval problem in a general setting. It has increased the speed of convergenc… ▽ More The phase retrieval problem is found in various areas of applications of engineering and applied physics. It is also a very active field of research in mathematics, signal processing and machine learning. In this paper, we present an accelerated version of the well known Fast Griffin-Lim algorithm (FGLA) for the phase retrieval problem in a general setting. It has increased the speed of convergence, and most importantly, the limit points of the generated sequence can reach a significantly smaller error than the ones generated by FGLA. We will give a motivation of the acceleration and compare it numerically to its predecessors and other algorithms typically used to solve similar problems. △ Less

Submitted 25 April, 2023; originally announced April 2023.

MSC Class: 90C26

On the relation of the frame-related operators of fusion frame systems

Authors: Lukas Köhldorfer, Peter Balazs

Abstract: Frames have been investigated frequently over the last few decades due to their valuable properties, which are desirable for various applications as well as interesting for theory. Some applications additionally require distributed processing techniques, which naturally leads to the concept of fusion frames and fusion frame systems. The latter consists of a system of subspaces, equipped with local… ▽ More Frames have been investigated frequently over the last few decades due to their valuable properties, which are desirable for various applications as well as interesting for theory. Some applications additionally require distributed processing techniques, which naturally leads to the concept of fusion frames and fusion frame systems. The latter consists of a system of subspaces, equipped with local frames on each of them, and a global frame. In this paper, we investigate the relations of the associated frame-related operators on all those three levels. For that we provide a detailed investigation on bounded block diagonal operators between Hilbert direct sums. We give the relation of the frame-related operators of the fusion frame and the corresponding frame systems in terms of operator identities. By applying these identities we prove further properties of fusion frame systems. △ Less

Submitted 27 March, 2023; originally announced March 2023.

Journal ref: Sampling Theory, Signal Processing, and Data Analysis 21(9) 2023

A Survey of Fusion Frames in Hilbert Spaces

Authors: Lukas Köhldorfer, Peter Balazs, Pete Casazza, Sigrid Heineken, Clara Hollomey, Patricia Morillas, Mitra Shamsabadi

Abstract: Fusion frames are a very active area of research today because of their myriad of applications in pure mathematics, applied mathematics, engineering, medicine, signal and image processing and much more. They provide a great flexibility for designing sets of vectors for applications and are therefore prominent in all these areas, including e.g. mitigating the effects of noise in a signal or giving… ▽ More Fusion frames are a very active area of research today because of their myriad of applications in pure mathematics, applied mathematics, engineering, medicine, signal and image processing and much more. They provide a great flexibility for designing sets of vectors for applications and are therefore prominent in all these areas, including e.g. mitigating the effects of noise in a signal or giving robustness to erasures. In this chapter, we present the fundamentals of fusion frame theory with an emphasis on their delicate relation to frame theory. The goal here is to provide researchers and students with an easy entry into this topic. Proofs for fusion frames will be self-contained and differences between frames and fusion frames are analyzed. In particular, we focus on the subtleties of fusion frame duality. We also provide a reproducible research implementation. △ Less

Submitted 2 March, 2023; originally announced March 2023.

Journal ref: Sampling, Approximation, and Signal Analysis (Harmonic Analysis in the Spirit of J. Rowland Higgins), S. Casey, M. Dodson, J. Paulo, J. Ferreira and A. Zayed (Eds.) (2024)

Feasibility of the EDICAM camera for runaway electron detection in JT-60SA disruptions

Authors: Soma Olasz, Mathias Hoppe, Tamás Szepesi, Kensaku Kamiya, Peter Balazs, Gergo I. Pokol

Abstract: The visible camera system EDICAM (Event Detection Intelligent Camera), recently installed on JT-60SA, is simulated to assess whether it can be used for measuring synchrotron radiation from relativistic runaway electrons. In this simulation, the SOFT synthetic synchrotron diagnostic framework is used to compute the synthetic synchrotron camera images from a JT-60SA-like disruption modelled with the… ▽ More The visible camera system EDICAM (Event Detection Intelligent Camera), recently installed on JT-60SA, is simulated to assess whether it can be used for measuring synchrotron radiation from relativistic runaway electrons. In this simulation, the SOFT synthetic synchrotron diagnostic framework is used to compute the synthetic synchrotron camera images from a JT-60SA-like disruption modelled with the DREAM disruption simulation code. In the studied scenario, a large amount of argon is added to the plasma, and a disruption is simulated by starting a prescribed exponential temperature drop and finishing with further cooling provided by the argon in a self-consistent simulation of the current quench. The background plasma evolution is calculated by DREAM self-consistently with the fast electron population, which is modelled kinetically. The resulting runaway electron distribution function along with the parameters of the EDICAM visible camera system are used as an input to the SOFT framework to assess the feasibility of the camera for runaway electron detection. We find that the runaway electron beam formed in the disruption can produce synchrotron radiation observable by the EDICAM system, thus enabling the use of the EDICAM for the characterization of runaway electron beams. △ Less

Submitted 27 September, 2023; v1 submitted 10 January, 2023; originally announced January 2023.

Comments: 19 pages, 8 figures. The final published version is uploaded

Journal ref: Fusion Engineering and Design, 195, (2023), 113940

Special behavior of alkali beam emission spectroscopy in low-ion-temperature plasma

Authors: P. Balázs, O. Asztalos, G. Anda, M. Vecsei, S. Zoletnik, S. T. A. Kumar, G. I. Pokol

Abstract: Beam emission spectroscopy (BES) is a powerful plasma diagnostic method especially suited for the measurement of plasma density and its fluctuations. As such, synthetic BES codes are regularly used to aid the design or utilization of these diagnostic systems. However, synthetic diagnostics can also be used to study the method in previously not yet explored operational conditions. This paper presen… ▽ More Beam emission spectroscopy (BES) is a powerful plasma diagnostic method especially suited for the measurement of plasma density and its fluctuations. As such, synthetic BES codes are regularly used to aid the design or utilization of these diagnostic systems. However, synthetic diagnostics can also be used to study the method in previously not yet explored operational conditions. This paper presents such an analysis utilizing the RENATE-OD synthetic diagnostic code for a hypothetical alkali BES system on the HSX stellarator. HSX is a device featuring an unusual operating regime in the world of fusion devices due to the low ion temperature and low plasma density. It was found that BES shows unusual tendencies in these conditions. The relation between beam energy and plasma penetration in low-ion-temperature plasma, together with unique emission features facilitated by low-density plasma, and the underlying reasons behind these features are explored in this paper. △ Less

Submitted 14 March, 2023; v1 submitted 4 January, 2023; originally announced January 2023.

Quantitative bounds for unconditional pairs of frames

Authors: Peter Balazs, Daniel Freeman, Roxana Popescu, Michael Speckbacher

Abstract: We formulate a quantitative finite-dimensional conjecture about frame multipliers and prove that it is equivalent to Conjecture 1 in [SB2]. We then present solutions to the conjecture for certain classes of frame multipliers. In particular, we prove that there is a universal constant $κ>0$ so that for all $C,β>0$ and $N\in\mathbb{N}$ the following is true. Let $(x_j)_{j=1}^N$ and… ▽ More We formulate a quantitative finite-dimensional conjecture about frame multipliers and prove that it is equivalent to Conjecture 1 in [SB2]. We then present solutions to the conjecture for certain classes of frame multipliers. In particular, we prove that there is a universal constant $κ>0$ so that for all $C,β>0$ and $N\in\mathbb{N}$ the following is true. Let $(x_j)_{j=1}^N$ and $(f_j)_{j=1}^N$ be sequences in a finite dimensional Hilbert space which satisfy $\|x_j\|=\|f_j\|$ for all $1\leq j\leq N$ and $$\Big\|\sum_{j=1}^N \varepsilon_j\langle x,f_j\rangle x_j\Big\|\leq C\|x\|, \qquad\textrm{ for all $x\in \ell_2^M$ and $|\varepsilon_j|=1$}. $$ If the frame operator for $(f_j)_{j=1}^N$ has eigenvalues $λ_1\geq...\geqλ_M$ and $λ_1\leq βM^{-1}\sum_{j=1}^Mλ_j$ then $(f_j)_{j=1}^N$ has Bessel bound $κβ^2 C$. The same holds for $(x_j)_{j=1}^N$. △ Less

Submitted 1 December, 2022; originally announced December 2022.

Comments: 19 pages

MSC Class: 42C15; 46B15; 60B11

The affine ensemble: determinantal point processes associated with the ax+b group

Authors: Luis Daniel Abreu, Peter Balazs, Smiljana Jakšić

Abstract: We introduce the affine ensemble, a class of determinantal point processes (DPP) in the half-plane C^+ associated with the ax+b (affine) group, depending on an admissible Hardy function ψ. We obtain the asymptotic behavior of the variance, the exact value of the asymptotic constant, and non-asymptotic upper and lower bounds for the variance on a compact set Ω contained in C^+. As a special case on… ▽ More We introduce the affine ensemble, a class of determinantal point processes (DPP) in the half-plane C^+ associated with the ax+b (affine) group, depending on an admissible Hardy function ψ. We obtain the asymptotic behavior of the variance, the exact value of the asymptotic constant, and non-asymptotic upper and lower bounds for the variance on a compact set Ω contained in C^+. As a special case one recovers the DPP related to the weighted Bergman kernel. When ψ is chosen within a finite family whose Fourier transform are Laguerre functions, we obtain the DPP associated to hyperbolic Landau levels, the eigenspaces of the finite spectrum of the Maass Laplacian with a magnetic field. △ Less

Submitted 15 October, 2022; originally announced October 2022.

Comments: 15 pages; J. Math. Soc. Japan, in press

Time-frequency analysis on flat tori and Gabor frames in finite dimensions

Authors: Luis Daniel Abreu, Peter Balazs, Nicki Holighaus, Franz Luef, Michael Speckbacher

Abstract: We provide the foundations of a Hilbert space theory for the short-time Fourier transform (STFT) where the flat tori \begin{equation*} \mathbb{T}_{N}^2=\mathbb{R}^2/(\mathbb{Z}\times N\mathbb{Z})=[0,1]\times \lbrack 0,N] \end{equation*} act as phase spaces. We work on an $N$-dimensional subspace $S_{N}$ of distributions periodic in time and frequency in the dual $S_0'(\mathbb{R})$ of the Feichting… ▽ More We provide the foundations of a Hilbert space theory for the short-time Fourier transform (STFT) where the flat tori \begin{equation*} \mathbb{T}_{N}^2=\mathbb{R}^2/(\mathbb{Z}\times N\mathbb{Z})=[0,1]\times \lbrack 0,N] \end{equation*} act as phase spaces. We work on an $N$-dimensional subspace $S_{N}$ of distributions periodic in time and frequency in the dual $S_0'(\mathbb{R})$ of the Feichtinger algebra $S_0(\mathbb{R})$ and equip it with an inner product. To construct the Hilbert space $S_{N}$ we apply a suitable double periodization operator to $S_0(\mathbb{R})$. On $S_{N}$, the STFT is applied as the usual STFT defined on $S_0'(\mathbb{R})$. This STFT is a continuous extension of the finite discrete Gabor transform from the lattice onto the entire flat torus. As such, sampling theorems on flat tori lead to Gabor frames in finite dimensions. For Gaussian windows, one is lead to spaces of analytic functions and the construction allows to prove a necessary and sufficient Nyquist rate type result, which is the analogue, for Gabor frames in finite dimensions, of a well known result of Lyubarskii and Seip-Wallst{é}n for Gabor frames with Gaussian windows and which, for $N$ odd, produces an explicit \emph{full spark Gabor frame}. The compactness of the phase space, the finite dimension of the signal spaces and our sampling theorem offer practical advantages in some applications. We illustrate this by discussing a problem of current research interest: recovering signals from the zeros of their noisy spectrograms. △ Less

Submitted 23 October, 2023; v1 submitted 9 September, 2022; originally announced September 2022.

MSC Class: 42C40; 46E15; 42C30; 46E22; 42C15

Comparisons between Fourier and STFT multipliers: the smoothing effect of the Short-time Fourier Transform

Authors: Peter Balazs, Federico Bastianoni, Elena Cordero, Hans G. Feichtinger, Nina Schweighofer

Abstract: We study the connection between STFT multipliers $A^{g_1,g_2}_{1\otimes m}$ having windows $g_1,g_2$, symbols $a(x,ω)=(1\otimes m)(x,ω)=m(ω)$, $(x,ω)\in\mathbb{R}^{2d}$, and the Fourier multipliers $T_{m_2}$ with symbol $m_2$ on $\mathbb{R}^d$. We find sufficient and necessary conditions on symbols $m,m_2$ and windows $g_1,g_2$ for the equality $T_{m_2}= A^{g_1,g_2}_{1\otimes m}$. For $m=m_2$ the… ▽ More We study the connection between STFT multipliers $A^{g_1,g_2}_{1\otimes m}$ having windows $g_1,g_2$, symbols $a(x,ω)=(1\otimes m)(x,ω)=m(ω)$, $(x,ω)\in\mathbb{R}^{2d}$, and the Fourier multipliers $T_{m_2}$ with symbol $m_2$ on $\mathbb{R}^d$. We find sufficient and necessary conditions on symbols $m,m_2$ and windows $g_1,g_2$ for the equality $T_{m_2}= A^{g_1,g_2}_{1\otimes m}$. For $m=m_2$ the former equality holds only for particular choices of window functions in modulation spaces, whereas it never occurs in the realm of Lebesgue spaces. In general, the STFT multiplier $A^{g_1,g_2}_{1\otimes m}$, also called localization operator, presents a smoothing effect due to the so-called two-window short-time Fourier transform which enters in the definition of $A^{g_1,g_2}_{1\otimes m}$. As a by-product we prove necessary conditions for the continuity of anti-Wick operators $A^{g,g}_{1\otimes m}: L^p\to L^q$ having multiplier $m$ in weak $L^r$ spaces. Finally, we exhibit the related results for their discrete counterpart: in this setting STFT multipliers are called Gabor multipliers whereas Fourier multiplier are better known as linear time invariant (LTI) filters. △ Less

Submitted 14 March, 2022; v1 submitted 2 March, 2022; originally announced March 2022.

Comments: 39 pages, 3 figures

Journal ref: Journal of Mathematical Analysis and Applications Vol. 529 (1): 127579 (2024)

Fast Matching Pursuit with Multi-Gabor Dictionaries

Authors: Zdeněk Průša, Nicki Holighaus, Peter Balazs

Abstract: Finding the best K-sparse approximation of a signal in a redundant dictionary is an NP-hard problem. Suboptimal greedy matching pursuit (MP) algorithms are generally used for this task. In this work, we present an acceleration technique and an implementation of the matching pursuit algorithm acting on a multi-Gabor dictionary, i.e., a concatenation of several Gabor-type time-frequency dictionaries… ▽ More Finding the best K-sparse approximation of a signal in a redundant dictionary is an NP-hard problem. Suboptimal greedy matching pursuit (MP) algorithms are generally used for this task. In this work, we present an acceleration technique and an implementation of the matching pursuit algorithm acting on a multi-Gabor dictionary, i.e., a concatenation of several Gabor-type time-frequency dictionaries, each of which consisting of translations and modulations of a possibly different window and time and frequency shift parameters. The technique is based on pre-computing and thresholding inner products between atoms and on updating the residual directly in the coefficient domain, i.e., without the round-trip to the signal domain. Since the proposed acceleration technique involves an approximate update step, we provide theoretical and experimental results illustrating the convergence of the resulting algorithm. The implementation is written in C (compatible with C99 and C++11) and we also provide Matlab and GNU Octave interfaces. For some settings, the implementation is up to 70 times faster than the standard Matching Pursuit Toolkit (MPTK). △ Less

Submitted 16 February, 2022; originally announced February 2022.

Frame-related Sequences in Chains and Scales of Hilbert Spaces

Authors: Peter Balazs, Giorgia Bellomonte, Hessam Hosseinnezhad

Abstract: Frames for Hilbert spaces are interesting for mathematicians but also important for applications e.g. in signal analysis and in physics. Both in mathematics and physics it is natural to consider a full scale of spaces, and not only a single one. In this paper, we study how certain frame-related properties, as completeness or the property of being a (semi-)frame, of a certain sequence in one of the… ▽ More Frames for Hilbert spaces are interesting for mathematicians but also important for applications e.g. in signal analysis and in physics. Both in mathematics and physics it is natural to consider a full scale of spaces, and not only a single one. In this paper, we study how certain frame-related properties, as completeness or the property of being a (semi-)frame, of a certain sequence in one of the spaces propagate to other spaces in a scale. We link that to the properties of the respective frame-related operators, like analysis or synthesis. We start with a detailed survey of the theory of Hilbert chains. Using a canonical isomorphism the properties of frame sequences are naturally preserved between different spaces. We also show that some results can be transferred if the original sequence is considered, in particular that the upper semi-frame property is kept in larger spaces, while the lower one to smaller ones. This leads to a negative result: a sequence can never be a frame for two Hilbert spaces of the scale if the scale is non-trivial, i.e. spaces are not equal. △ Less

Submitted 17 February, 2022; originally announced February 2022.

MSC Class: 42C15; 46C99; 47A70

Journal ref: Axioms, Vol. 11(4) 2022

Phase-Based Signal Representations for Scattering

Authors: Daniel Haider, Peter Balazs, Nicki Holighaus

Abstract: The scattering transform is a non-linear signal representation method based on cascaded wavelet transform magnitudes. In this paper we introduce phase scattering, a novel approach where we use phase derivatives in a scattering procedure. We first revisit phase-related concepts for representing time-frequency information of audio signals, in particular, the partial derivatives of the phase in the t… ▽ More The scattering transform is a non-linear signal representation method based on cascaded wavelet transform magnitudes. In this paper we introduce phase scattering, a novel approach where we use phase derivatives in a scattering procedure. We first revisit phase-related concepts for representing time-frequency information of audio signals, in particular, the partial derivatives of the phase in the time-frequency domain. By putting analytical and numerical results in a new light, we set the basis to extend the phase-based representations to higher orders by means of a scattering transform, which leads to well localized signal representations of large-scale structures. All the ideas are introduced in a general way and then applied using the STFT. △ Less

Submitted 15 February, 2022; originally announced February 2022.

Journal ref: 29th European Signal Processing Conference (EUSIPCO) 2021

Audio Inpainting via $\ell_1$-Minimization and Dictionary Learning

Authors: Shristi Rajbamshi, Georg Tauböck, Peter Balazs, Nicki Holighaus

Abstract: Audio inpainting refers to signal processing techniques that aim at restoring missing or corrupted consecutive samples in audio signals. Prior works have shown that $\ell_1$- minimization with appropriate weighting is capable of solving audio inpainting problems, both for the analysis and the synthesis models. These models assume that audio signals are sparse with respect to some redundant diction… ▽ More Audio inpainting refers to signal processing techniques that aim at restoring missing or corrupted consecutive samples in audio signals. Prior works have shown that $\ell_1$- minimization with appropriate weighting is capable of solving audio inpainting problems, both for the analysis and the synthesis models. These models assume that audio signals are sparse with respect to some redundant dictionary and exploit that sparsity for inpainting purposes. Remaining within the sparsity framework, we utilize dictionary learning to further increase the sparsity and combine it with weighted $\ell_1$-minimization adapted for audio inpainting to compensate for the loss of energy within the gap after restoration. Our experiments demonstrate that our approach is superior in terms of signal-to-distortion ratio (SDR) and objective difference grade (ODG) compared with its original counterpart. △ Less

Submitted 15 February, 2022; originally announced February 2022.

Continuous frames in tensor product Hilbert spaces, localization operators and density operators

Authors: Peter Balazs, Nenad Teofanov

Abstract: Continuous frames and tensor products are important topics in theoretical physics. This paper combines those concepts. We derive fundamental properties of continuous frames for tensor product of Hilbert spaces. This includes, for example, the consistency property, i.e. preservation of the frame property under the tensor product, and the description of the canonical dual tensors by those on the Hil… ▽ More Continuous frames and tensor products are important topics in theoretical physics. This paper combines those concepts. We derive fundamental properties of continuous frames for tensor product of Hilbert spaces. This includes, for example, the consistency property, i.e. preservation of the frame property under the tensor product, and the description of the canonical dual tensors by those on the Hilbert space level. We show the full characterization of all dual systems for a given continuous frame, a result interesting by itself, and apply this to dual tensor frames. Furthermore, we discuss the existence on non-simple tensor product (dual) frames. Continuous frame multipliers and their Schatten class properties are considered in the context of tensor products. In particular, we give sufficient conditions for obtaining partial trace multipliers of the same form, which is illustrated with examples related to short-time Fourier transform and wavelet localization operators. As an application, we offer an interpretation of a class of tensor product continuous frame multipliers as density operators for bipartite quantum states, and show how their structure can be restricted to the corresponding partial traces. △ Less

Submitted 14 February, 2022; v1 submitted 14 July, 2021; originally announced July 2021.

Comments: 29 pages

MSC Class: 42C15

Representation of Operators Using Fusion Frames

Authors: Peter Balazs, Mitra Shamsabadi, Ali Akbar Arefijamaal, Chilles Gardon

Abstract: For finding the numerical solution of operator equations in many applications a decomposition in subspaces is needed. Therefore, it is necessary to extend the known method of matrix representation to the utilization of fusion frames. In this paper we investigate this representation of operators on a Hilbert space $\Hil$ with Bessel fusion sequences, fusion frame and Riesz decompositions. We will g… ▽ More For finding the numerical solution of operator equations in many applications a decomposition in subspaces is needed. Therefore, it is necessary to extend the known method of matrix representation to the utilization of fusion frames. In this paper we investigate this representation of operators on a Hilbert space $\Hil$ with Bessel fusion sequences, fusion frame and Riesz decompositions. We will give the basic definitions. We will show some structural results and give some examples. Furthermore, in the case of Riesz decompositions, we prove that those functions are isomorphisms. Also, we want to find the pseudo-inverse and the inverse (if there exists) of such matrix representations. We are going to apply this idea to the Schatten $p$-class operators. Finally, we show that tensors of fusion frame are frames in the space of Hilbert-Schmidt operators. △ Less

Submitted 13 July, 2020; originally announced July 2020.

MSC Class: (primary:) 41A58; 47A58 (secondary:) 65J10

Image-based material characterization of complex microarchitectured additively manufactured structures

Authors: N. Korshunova, J. Jomo, G. Lékó, D. Reznik, P. Balázs, S. Kollmannsberger

Abstract: Significant developments in the field of additive manufacturing (AM) allowed the fabrication of complex microarchitectured components with varying porosity across different scales. However, due to the high complexity of this process, the final parts can exhibit significant variations in the nominal geometry. Computer tomographic images of 3D printed components provide extensive information about t… ▽ More Significant developments in the field of additive manufacturing (AM) allowed the fabrication of complex microarchitectured components with varying porosity across different scales. However, due to the high complexity of this process, the final parts can exhibit significant variations in the nominal geometry. Computer tomographic images of 3D printed components provide extensive information about these microstructural variations, such as process-induced porosity, surface roughness, and other undesired morphological discrepancies. Yet, techniques to incorporate these imperfect AM geometries into the numerical material characterization analysis are computationally demanding. In this contribution, an efficient image-to-material-characterization framework using the high-order parallel Finite Cell Method is proposed. In this way, a flexible non-geometry-conforming discretization facilitates mesh generation for very complex microstructures at hand and allows a direct analysis of the images stemming from CT-scans. Numerical examples including a comparison to the experiments illustrate the potential of the proposed framework in the field of additive manufacturing product simulation. △ Less

Submitted 22 July, 2020; v1 submitted 16 December, 2019; originally announced December 2019.

Harmonic-aligned Frame Mask Based on Non-stationary Gabor Transform with Application to Content-dependent Speaker Comparison

Authors: Feng Huang, Peter Balazs

Abstract: We propose harmonic-aligned frame mask for speech signals using non-stationary Gabor transform (NSGT). A frame mask operates on the transfer coefficients of a signal and consequently converts the signal into a counterpart signal. It depicts the difference between the two signals. In preceding studies, frame masks based on regular Gabor transform were applied to single-note instrumental sound analy… ▽ More We propose harmonic-aligned frame mask for speech signals using non-stationary Gabor transform (NSGT). A frame mask operates on the transfer coefficients of a signal and consequently converts the signal into a counterpart signal. It depicts the difference between the two signals. In preceding studies, frame masks based on regular Gabor transform were applied to single-note instrumental sound analysis. This study extends the frame mask approach to speech signals. For voiced speech, the fundamental frequency is usually changing consecutively over time. We employ NSGT with pitch-dependent and therefore time-varying frequency resolution to attain harmonic alignment in the transform domain and hence yield harmonic-aligned frame masks for speech signals. We propose to apply the harmonic-aligned frame mask to content-dependent speaker comparison. Frame masks, computed from voiced signals of a same vowel but from different speakers, were utilized as similarity measures to compare and distinguish the speaker identities (SID). Results obtained with deep neural networks demonstrate that the proposed frame mask is valid in representing speaker characteristics and shows a potential for SID applications in limited data scenarios. △ Less

Submitted 23 April, 2019; originally announced April 2019.

Comments: Interspeech2019

Kernel Theorems in Coorbit Theory

Authors: Peter Balazs, Karlheinz Gröchenig, Michael Speckbacher

Abstract: We prove general kernel theorems for operators acting between coorbit spaces. These are Banach spaces associated to an integrable representation of a locally compact group and contain most of the usual function spaces (Besov spaces, modulation spaces, etc.). A kernel theorem describes the form of every bounded operator between a coorbit space of test functions and distributions by means of a kerne… ▽ More We prove general kernel theorems for operators acting between coorbit spaces. These are Banach spaces associated to an integrable representation of a locally compact group and contain most of the usual function spaces (Besov spaces, modulation spaces, etc.). A kernel theorem describes the form of every bounded operator between a coorbit space of test functions and distributions by means of a kernel in a coorbit space associated to the tensor product representation. As special cases we recover Feichtinger's kernel theorem for modulation spaces and the recent generalizations by Cordero and Nicola. We also obtain a kernel theorem for operators between the Besov spaces $\dot{B}^0_{1,1}$ and $\dot{B}^{0}_{\infty, \infty }$. △ Less

Submitted 7 March, 2019; originally announced March 2019.

MSC Class: 42B35; 42C15; 46A32; 47B34

Journal ref: Transactions of the American Mathematical Society, Ser. B 6, pp. 346 - 364 (2019)

Frames for the solution of operator equations in Hilbert spaces with fixed dual pairing

Authors: Peter Balazs, Helmut Harbrecht

Abstract: For the solution of operator equations, Stevenson introduced a definition of frames, where a Hilbert space and its dual are {\em not} identified. This means that the Riesz isomorphism is not used as an identification, which, for example, does not make sense for the Sobolev spaces $H_0^1(Ω)$ and $H^{-1}(Ω)$. In this article, we are going to revisit the concept of Stevenson frames and introduce it f… ▽ More For the solution of operator equations, Stevenson introduced a definition of frames, where a Hilbert space and its dual are {\em not} identified. This means that the Riesz isomorphism is not used as an identification, which, for example, does not make sense for the Sobolev spaces $H_0^1(Ω)$ and $H^{-1}(Ω)$. In this article, we are going to revisit the concept of Stevenson frames and introduce it for Banach spaces. This is equivalent to $\ell^2$-Banach frames. It is known that, if such a system exists, by defining a new inner product and using the Riesz isomorphism, the Banach space is isomorphic to a Hilbert space. In this article, we deal with the contrasting setting, where $\mathcal H$ and $\mathcal H'$ are not identified, and equivalent norms are distinguished, and show that in this setting the investigation of $\ell^2$-Banach frames make sense. △ Less

Submitted 20 August, 2018; originally announced August 2018.

Comments: 23 pages; accepted for publication in 'Numerical Functional Analysis and Optimization'

MSC Class: 42C15; 65J10; 47A50;

Journal ref: Numerical Functional Analysis and Optimization, Vol. 40 (1), pp. 65-84 (2019)

U-cross Gram matrices and their invertibility

Authors: Peter Balazs, Mitra Shamsabadi, Ali Akbar Arefijamaal, Asghar Rahimi

Abstract: The Gram matrix is defined for Bessel sequences by combining synthesis with subsequent analysis operators. If different sequences are used and an operator U is inserted we reach so called U-cross Gram matrices. This can be seen as reinterpretation of the matrix representation of operators using frames. In this paper we investigate some necessary or sufficient conditions for Schatten p-class proper… ▽ More The Gram matrix is defined for Bessel sequences by combining synthesis with subsequent analysis operators. If different sequences are used and an operator U is inserted we reach so called U-cross Gram matrices. This can be seen as reinterpretation of the matrix representation of operators using frames. In this paper we investigate some necessary or sufficient conditions for Schatten p-class properties and the invertibility of U-cross Gram matrices. In particular, we show that under mild conditions the pseudo-inverse of a U-cross Gram matrix can always be represented as a U-cross Gram matrix with dual frames of the given ones. We link some properties of U-cross Gram matrices to approximate duals. Finally, we state several stability results. More precisely, it is shown that the invertibility of U-cross Gram matrices is preserved under small perturbations. △ Less

Submitted 20 March, 2019; v1 submitted 31 March, 2018; originally announced April 2018.

Comments: 29 pages

MSC Class: 41A58 (Primary); 43A35 (Secondary)

Journal ref: Journal of Mathematical Analysis and Applications, Vol. 476 (2), pp. 367-390 (2019)

A survey on the unconditional convergence and the invertibility of multipliers with implementation

Authors: Diana T. Stoeva, Peter Balazs

Abstract: The paper presents a survey over frame multipliers and related concepts. In particular, it includes a short motivation of why multipliers are of interest to consider, a review as well as extension of recent results, devoted to the unconditional convergence of multipliers, sufficient and/or necessary conditions for the invertibility of multipliers, and representation of the inverse via Neumann-like… ▽ More The paper presents a survey over frame multipliers and related concepts. In particular, it includes a short motivation of why multipliers are of interest to consider, a review as well as extension of recent results, devoted to the unconditional convergence of multipliers, sufficient and/or necessary conditions for the invertibility of multipliers, and representation of the inverse via Neumann-like series and via multipliers with particular parameters. Multipliers for frames with specific structure, namely, Gabor and wavelet multipliers, are also considered. Some of the results for the representation of the inverse multiplier are implemented in Matlab codes and the algorithms are described. △ Less

Submitted 1 March, 2018; originally announced March 2018.

MSC Class: 42C15; 47A05

Journal ref: In: Casey, S. D., Okoudjou, K., Robinson, M., Sadler, B. (eds.), Sampling - Theory and Applications, Applied and Numerical Harmonic Analysis, 2020, 169-192

The invertibility of U-fusion cross Gram matrices of operators

Authors: Mitra Shamsabadi, Ali Akbar Arefijamaal, Peter Balazs

Abstract: For applications like the numerical solution of physical equations a discretization scheme for operators is necessary. Recently frames have been used for such an operator representation. In this paper, we apply fusion frames for this task. We interpret the operator representation using fusion frames as a generalization of fusion Gram matrices. We present the basic definition of $U$-fusion cross Gr… ▽ More For applications like the numerical solution of physical equations a discretization scheme for operators is necessary. Recently frames have been used for such an operator representation. In this paper, we apply fusion frames for this task. We interpret the operator representation using fusion frames as a generalization of fusion Gram matrices. We present the basic definition of $U$-fusion cross Gram matrices of operators for a bounded operator $U$. We give sufficient conditions for their (pseudo-)invertibility and present explicit formulas for the inverse. In particular, we characterize fusion Riesz bases and fusion orthonormal bases by such matrices. Finally, we look at which perturbations of fusion Bessel sequences preserve the invertibility of the fusion Gram matrix of operators. △ Less

Submitted 30 October, 2019; v1 submitted 31 October, 2017; originally announced November 2017.

Comments: 19 pages

MSC Class: 42C15 (Primary); 47A05 (Secondary)

Frames, their relatives and reproducing kernel Hilbert spaces

Authors: Michael Speckbacher, Peter Balazs

Abstract: This paper considers different facets of the interplay between reproducing kernel Hilbert spaces (RKHS) and stable analysis/synthesis processes: First, we analyze the structure of the reproducing kernel of a RKHS using frames and reproducing pairs. Second, we present a new approach to prove the result that finite redundancy of a continuous frame implies atomic structure of the underlying measure s… ▽ More This paper considers different facets of the interplay between reproducing kernel Hilbert spaces (RKHS) and stable analysis/synthesis processes: First, we analyze the structure of the reproducing kernel of a RKHS using frames and reproducing pairs. Second, we present a new approach to prove the result that finite redundancy of a continuous frame implies atomic structure of the underlying measure space. Our proof uses the RKHS structure of the range of the analysis operator. This in turn implies that all the attempts to extend the notion of Riesz basis to general measure spaces are fruitless since every such family can be identified with a discrete Riesz basis. Finally, we show how the range of the analysis operators of a reproducing pair can be equipped with a RKHS structure. △ Less

Submitted 1 April, 2019; v1 submitted 10 April, 2017; originally announced April 2017.

MSC Class: 42C15; 46E22 (primary); 47B32 (secondary)

Discretization in generalized coorbit spaces: extensions, annotations and errata for "Continuous Frames, Function Spaces and the Discretization Problem" by M. Fornasier and H. Rauhut

Authors: Nicki Holighaus, Peter Balazs

Abstract: During the process of writing the manuscript ["Continuous warped time-frequency representations - Coorbit spaces and discretization", N. Holighaus, C. Wiesmeyr and P. Balazs], the work ["Continuous Frames, Function Spaces and the Discretization Problem" by M. Fornasier and H. Rauhut - (1)] was one of the major foundations of our results and, naturally, we found ourselves going back to reading that… ▽ More During the process of writing the manuscript ["Continuous warped time-frequency representations - Coorbit spaces and discretization", N. Holighaus, C. Wiesmeyr and P. Balazs], the work ["Continuous Frames, Function Spaces and the Discretization Problem" by M. Fornasier and H. Rauhut - (1)] was one of the major foundations of our results and, naturally, we found ourselves going back to reading that contribution once and again. In particular in Section 5, which is concerned with the discretization problem, we have found some typographical errors, small inaccuracies and some parts that we just would have wished to be slightly more accessible. Finally, for our own theory, a generalization of a central definition required us to verify that all the derivations in Section 5 of (1) still hold after the necessary modifications. Considering the importance of the results in (1) for the community, this was reason enough to start this side project of re-writing that least accessible portion of Fornasier and Rauhut's manuscript, eliminating the errors we found, adding annotations where we consider them useful and modifying the results to take into account the generalization we require for our own work. What you see is the result of our endeavor, a one-to-one substitute for Section 5 in (1). △ Less

Submitted 21 February, 2017; originally announced February 2017.

Redundant Representation of Operators

Authors: Peter Balazs, Georg Rieckh

Abstract: To be able to solve operator equations numerically a discretization of those operators is necessary. In the Galerkin approach bases are used to achieve discretized versions of operators. In a more general set-up, frames can be used to sample the involved signal spaces and therefore those operators. Here we look at the redundant representation of operators resulting from a matrix representation usi… ▽ More To be able to solve operator equations numerically a discretization of those operators is necessary. In the Galerkin approach bases are used to achieve discretized versions of operators. In a more general set-up, frames can be used to sample the involved signal spaces and therefore those operators. Here we look at the redundant representation of operators resulting from a matrix representation using frames. We focus on injectivity, surjectivity and, in particular, invertibility of the involved operators and matrices. Furthermore we show sufficient conditions that the composition of matrices correspond to the composition of operators. △ Less

Submitted 19 December, 2016; originally announced December 2016.

Comments: 12 pages; extended version of "Peter Balazs and Georg Rieckh, Oversampling operators: Frame representation of operators, Analele Universitatii 'Eftimie Murgu' 18 (2011), no. 2, 107-114."

MSC Class: 42C15

A Guide to Localized Frames and Applications to Galerkin-like Representations of Operators

Authors: Peter Balazs, Karlheinz Gröchenig

Abstract: This chapter offers a detailed survey on intrinsically localized frames and the corresponding matrix representation of operators. We re-investigate the properties of localized frames and the associated Banach spaces in full detail. We investigate the representation of operators using localized frames in a Galerkin-type scheme. We show how the boundedness and the invertibility of matrices and opera… ▽ More This chapter offers a detailed survey on intrinsically localized frames and the corresponding matrix representation of operators. We re-investigate the properties of localized frames and the associated Banach spaces in full detail. We investigate the representation of operators using localized frames in a Galerkin-type scheme. We show how the boundedness and the invertibility of matrices and operators are linked and give some sufficient and necessary conditions for the boundedness of operators between the associated Banach spaces. △ Less

Submitted 29 November, 2016; originally announced November 2016.

Comments: 32 pages

Journal ref: In: Frames and Other Bases in Abstract and Function Space, Isaac Pesenson and Hrushikesh Mhaskar and Azita Mayeli and Quoc T. Le Gia and Ding-Xuan Zhou (Ed.) Birkhäuser, Cham 2017

Frame Theory for Signal Processing in Psychoacoustics

Authors: Peter Balazs, Nicki Holighaus, Thibaud Necciari, Diana Stoeva

Abstract: This review chapter aims to strengthen the link between frame theory and signal processing tasks in psychoacoustics. On the one side, the basic concepts of frame theory are presented and some proofs are provided to explain those concepts in some detail. The goal is to reveal to hearing scientists how this mathematical theory could be relevant for their research. In particular, we focus on frame th… ▽ More This review chapter aims to strengthen the link between frame theory and signal processing tasks in psychoacoustics. On the one side, the basic concepts of frame theory are presented and some proofs are provided to explain those concepts in some detail. The goal is to reveal to hearing scientists how this mathematical theory could be relevant for their research. In particular, we focus on frame theory in a filter bank approach, which is probably the most relevant view-point for audio signal processing. On the other side, basic psychoacoustic concepts are presented to stimulate mathematicians to apply their knowledge in this field. △ Less

Submitted 3 November, 2016; originally announced November 2016.

Journal ref: In: Balan R., Benedetto J., Czaja W., Dellatorre M., Okoudjou K. (eds) Excursions in Harmonic Analysis, Vol. 5. Applied and Numerical Harmonic Analysis. Birkhäuser, Cham, 2017, 225-268

Reproducing pairs and Gabor systems at critical density

Authors: Michael Speckbacher, Peter Balazs

Abstract: We use the concept of reproducing pairs to study Gabor systems at critical density. First, we present a generalization of the Balian-Low theorem to the reproducing pairs setting. Then, we prove our main result that there exists a reproducing partner for the Gabor system of integer time-frequency shifts of the Gaussian. In other words, the coefficients for this Gabor expansion of a square integrabl… ▽ More We use the concept of reproducing pairs to study Gabor systems at critical density. First, we present a generalization of the Balian-Low theorem to the reproducing pairs setting. Then, we prove our main result that there exists a reproducing partner for the Gabor system of integer time-frequency shifts of the Gaussian. In other words, the coefficients for this Gabor expansion of a square integrable function can be calculated using inner products with an unstructured family of vectors in $ L^2(\R)$. This solves the possibly last open question for this system. △ Less

Submitted 12 January, 2017; v1 submitted 21 October, 2016; originally announced October 2016.

MSC Class: 42C15; 42C40

Journal ref: Journal of Mathematical Analysis and Applications, Vo. 455(2), pp. 1072-1087 (2017)

A Non-iterative Method for (Re)Construction of Phase from STFT Magnitude

Authors: Zdeněk Průša, Peter Balazs, Peter L. Søndergaard

Abstract: A non-iterative method for the construction of the Short-Time Fourier Transform (STFT) phase from the magnitude is presented. The method is based on the direct relationship between the partial derivatives of the phase and the logarithm of the magnitude of the un-sampled STFT with respect to the Gaussian window. Although the theory holds in the continuous setting only, the experiments show that the… ▽ More A non-iterative method for the construction of the Short-Time Fourier Transform (STFT) phase from the magnitude is presented. The method is based on the direct relationship between the partial derivatives of the phase and the logarithm of the magnitude of the un-sampled STFT with respect to the Gaussian window. Although the theory holds in the continuous setting only, the experiments show that the algorithm performs well even in the discretized setting (Discrete Gabor transform) with low redundancy using the sampled Gaussian window, the truncated Gaussian window and even other compactly supported windows like the Hann window. Due to the non-iterative nature, the algorithm is very fast and it is suitable for long audio signals. Moreover, solutions of iterative phase reconstruction algorithms can be improved considerably by initializing them with the phase estimate provided by the present algorithm. We present an extensive comparison with the state-of-the-art algorithms in a reproducible manner. △ Less

Submitted 1 September, 2016; originally announced September 2016.

Comments: 10 pages, 4 figures

Journal ref: IEEE Transactions on Audio, Speech and Language Processing, Vol. 25 (5), pp. 1154 - 1164 (2017)

Inpainting of long audio segments with similarity graphs

Authors: Nathanael Perraudin, Nicki Holighaus, Piotr Majdak, Peter Balazs

Abstract: We present a novel method for the compensation of long duration data loss in audio signals, in particular music. The concealment of such signal defects is based on a graph that encodes signal structure in terms of time-persistent spectral similarity. A suitable candidate segment for the substitution of the lost content is proposed by an intuitive optimization scheme and smoothly inserted into the… ▽ More We present a novel method for the compensation of long duration data loss in audio signals, in particular music. The concealment of such signal defects is based on a graph that encodes signal structure in terms of time-persistent spectral similarity. A suitable candidate segment for the substitution of the lost content is proposed by an intuitive optimization scheme and smoothly inserted into the gap, i.e. the lost or distorted signal region. Extensive listening tests show that the proposed algorithm provides highly promising results when applied to a variety of real-world music signals. △ Less

Submitted 23 February, 2018; v1 submitted 22 July, 2016; originally announced July 2016.

On the dual frame induced by an invertible frame multiplier

Authors: Diana T. Stoeva, Peter Balazs

Abstract: Recently it has been established that given an invertible frame multiplier with semi-normalized symbol, a specific dual of any of the two involved frames can be determined for the inversion purpose. The inverse can be represented as a multiplier with the reciprocal symbol, this particular dual of one of the given frames, and any dual of the other frame. The specific dual is the only one having thi… ▽ More Recently it has been established that given an invertible frame multiplier with semi-normalized symbol, a specific dual of any of the two involved frames can be determined for the inversion purpose. The inverse can be represented as a multiplier with the reciprocal symbol, this particular dual of one of the given frames, and any dual of the other frame. The specific dual is the only one having this property among all Bessel sequences. In this manuscript we extend the results showing that the specific dual with the above mentioned property is unique among all possible sequences. Furthermore, we allow the symbol to be not necessarily semi-normalized. Finally we characterize cases when the canonical dual frame and the new specific dual frame coincide. △ Less

Submitted 16 March, 2016; originally announced March 2016.

MSC Class: 42C15; 47A05

Journal ref: Sampling Theory in Signal and Image Processing 15 (2016), 119-130

The $α$-Modulation Transform: Admissibility, Coorbit Theory and Frames of Compactly Supported Functions

Authors: Michael Speckbacher, Dominik Bayer, Stephan Dahlke, Peter Balazs

Abstract: The $α$-modulation transform is a time-frequency transform generated by square-integrable representations of the affine Weyl-Heisenberg group modulo suitable subgroups. In this paper we prove new conditions that guarantee the admissibility of a given window function. We also show that the generalized coorbit theory can be applied to this setting, assuming specific regularity of the windows. This t… ▽ More The $α$-modulation transform is a time-frequency transform generated by square-integrable representations of the affine Weyl-Heisenberg group modulo suitable subgroups. In this paper we prove new conditions that guarantee the admissibility of a given window function. We also show that the generalized coorbit theory can be applied to this setting, assuming specific regularity of the windows. This then yields canonical constructions of Banach frames and atomic decompositions in $α$-modulation spaces. In particular, we prove the existence of compactly supported (in time domain) vectors that are admissible and satisfy all conditions within the coorbit machinery, which considerably go beyond known results. △ Less

Submitted 1 March, 2016; originally announced March 2016.

Comments: This article supersedes arXiv:1408.4971

MSC Class: 42C15; 42C40; 46E15 (primary); 46E35; 57S25 (secondary)

A Perceptually Motivated Filter Bank with Perfect Reconstruction for Audio Signal Processing

Authors: Thibaud Necciari, Nicki Holighaus, Peter Balazs, Zdenek Prusa

Abstract: Many audio applications rely on filter banks (FBs) to analyze, process, and re-synthesize sounds. To approximate the auditory frequency resolution in the signal chain, some applications rely on perceptually motivated FBs, the gammatone FB being a popular example. However, most perceptually motivated FBs only allow partial signal reconstruction at high redundancies and/or do not have good resistanc… ▽ More Many audio applications rely on filter banks (FBs) to analyze, process, and re-synthesize sounds. To approximate the auditory frequency resolution in the signal chain, some applications rely on perceptually motivated FBs, the gammatone FB being a popular example. However, most perceptually motivated FBs only allow partial signal reconstruction at high redundancies and/or do not have good resistance to sub-channel processing. This paper introduces an oversampled perceptually motivated FB enabling perfect reconstruction, efficient FB design, and adaptable redundancy. The filters are directly constructed in the frequency domain and linearly distributed on a perceptual frequency scale (e.g. ERB, Bark, or Mel scale). The proposed design allows for various filter shapes, uniform or non-uniform FB setting, and large down-sampling factors. For redundancies $\geq$ 3 perfect reconstruction is achieved by computing the canonical dual FB analytically. For lower redundancies perfect reconstruction is achieved using an iterative method. Experiments show performance improvements of the proposed approach when compared to the gammatone FB in terms of reconstruction error and resistance to sub-channel processing, especially at low redundancies. △ Less

Submitted 25 January, 2016; originally announced January 2016.

Reproducing pairs and the continuous nonstationary Gabor transform on LCA groups

Authors: Michael Speckbacher, Peter Balazs

Abstract: In this paper we introduce and investigate the concept of repro- ducing pairs as a generalization of continuous frames. Reproducing pairs yield a bounded analysis and synthesis process while the frame condition can be omitted at both stages. Moreover, we will investigate certain continuous frames (resp. reproducing pairs) on LCA groups, which can be described as a continuous version of nonstationa… ▽ More In this paper we introduce and investigate the concept of repro- ducing pairs as a generalization of continuous frames. Reproducing pairs yield a bounded analysis and synthesis process while the frame condition can be omitted at both stages. Moreover, we will investigate certain continuous frames (resp. reproducing pairs) on LCA groups, which can be described as a continuous version of nonstationary Ga- bor systems and state sufficient conditions for these systems to form a continuous frame (resp. reproducing pair). As a byproduct we iden- tify the structure of the frame operator (resp. resolution operator). We will apply our results to systems generated by a unitary action of a subset of the affine Weyl-Heisenberg group in $L^2(\mathbb{R})$. This setup will also serve as a nontrivial example of a system for which, whereas continuous frames exist, no dual system with the same structure exists even if we drop the frame property. △ Less

Submitted 27 May, 2015; originally announced May 2015.

Comments: arXiv admin note: substantial text overlap with arXiv:1407.6830

MSC Class: 22B99; 43A32; 42C15; 42C40

Journal ref: Journal of Physics A: Mathematical and Theoretical 48 (2015)

Continuous warped time-frequency representations - Coorbit spaces and discretization

Authors: Nicki Holighaus, Christoph Wiesmeyr, Peter Balazs

Abstract: We present a novel family of continuous, linear time-frequency transforms adaptable to a multitude of (nonlinear) frequency scales. Similar to classical time-frequency or time-scale representations, the representation coefficients are obtained as inner products with the elements of a continuously indexed family of time-frequency atoms. These atoms are obtained from a single prototype function, by… ▽ More We present a novel family of continuous, linear time-frequency transforms adaptable to a multitude of (nonlinear) frequency scales. Similar to classical time-frequency or time-scale representations, the representation coefficients are obtained as inner products with the elements of a continuously indexed family of time-frequency atoms. These atoms are obtained from a single prototype function, by means of modulation, translation and war**. By war** we refer to the process of nonlinear evaluation according to a bijective, increasing function, the war** function. Besides showing that the resulting integral transforms fulfill certain basic, but essential properties, such as continuity and invertibility, we will show that a large subclass of war** functions gives rise to families of generalized coorbit spaces, i.e. Banach spaces of functions whose representations possess a certain localization. Furthermore, we obtain sufficient conditions for subsampled warped time-frequency systems to form atomic decompositions and Banach frames. To this end, we extend results previously presented by Fornasier and Rauhut to a larger class of function systems via a simple, but crucial modification. The proposed method allows for great flexibility, but by choosing particular war** functions $Φ$ we also recover classical time-frequency representations, e.g. $Φ(t) = ct$ provides the short-time Fourier transform and $Φ(t) = log_a(t)$ provides wavelet transforms. This is illustrated by a number of examples provided in the manuscript. △ Less

Submitted 19 March, 2024; v1 submitted 18 March, 2015; originally announced March 2015.

Comments: Published version

Journal ref: Appl. Comput. Harmon. Anal. 47 (2019) 975-1013

Discrete coherent states for higher Landau levels

Authors: L. D. Abreu, P. Balazs, M. de Gosson, Z. Mouayn

Abstract: We consider the quantum dynamics of a charged particle evolving under the action of a constant homogeneous magnetic field, with emphasis on the discrete subgroups of the Heisenberg group (in the Euclidean case) and of the SL(2, R) group (in the Hyperbolic case). We investigate completeness properties of discrete coherent states associated with higher order Euclidean and hyperbolic Landau levels, p… ▽ More We consider the quantum dynamics of a charged particle evolving under the action of a constant homogeneous magnetic field, with emphasis on the discrete subgroups of the Heisenberg group (in the Euclidean case) and of the SL(2, R) group (in the Hyperbolic case). We investigate completeness properties of discrete coherent states associated with higher order Euclidean and hyperbolic Landau levels, partially extending classic results of Perelomov and of Bargmann, Butera, Girardello and Klauder. In the Euclidean case, our results follow from identifying the completeness problem with known results from the theory of Gabor frames. The results for the hyperbolic setting follow by using a combination of methods from coherent states, time-scale analysis and the theory of Fuchsian groups and their associated automorphic forms. △ Less

Submitted 12 September, 2015; v1 submitted 10 March, 2015; originally announced March 2015.

Comments: Revised for Annals of Physics

Journal ref: Annals of Physics, Vol. 363 pp. 337-353 (2015)

Admissibility for $α$-Modulation Spaces

Authors: Peter Balazs, Dominik Bayer, Michael Speckbacher

Abstract: This paper is concerned with frame decompositions of $α$-modulation spaces. These spaces can be obtained as coorbit spaces for square-integrable representations of the affine Weyl-Heisenberg group modulo suitable subgroups. The theory yields canonical constructions for Banach frames or atomic decompositions in $α$-modulation spaces. A necessary ingredient in this abstract machinery is the existenc… ▽ More This paper is concerned with frame decompositions of $α$-modulation spaces. These spaces can be obtained as coorbit spaces for square-integrable representations of the affine Weyl-Heisenberg group modulo suitable subgroups. The theory yields canonical constructions for Banach frames or atomic decompositions in $α$-modulation spaces. A necessary ingredient in this abstract machinery is the existence of generating functions that are admissible for the representation. For numerical purposes, admissible atoms with compact support are necessary. We show new admissibility conditions that considerably improve upon known results. In particular, we prove the existence of admissible vectors that have compact support in time domain. △ Less

Submitted 21 August, 2014; originally announced August 2014.

Comments: Preprint Version

The continuous nonstationary Gabor transform on LCA groups with applications to representations of the affine Weyl-Heisenberg group

Authors: Michael Speckbacher, Peter Balazs

Abstract: In this paper we introduce and investigate the concept of reproducing pairs which generalizes continuous frames. We will introduce a concept that represents a unifying way to look at certain continuous frames (resp. reproducing pairs) on LCA groups, which can be described as continuous nonstationary Gabor systems and investigate conditions for these systems to form a continuous frame (resp. reprod… ▽ More In this paper we introduce and investigate the concept of reproducing pairs which generalizes continuous frames. We will introduce a concept that represents a unifying way to look at certain continuous frames (resp. reproducing pairs) on LCA groups, which can be described as continuous nonstationary Gabor systems and investigate conditions for these systems to form a continuous frame (resp. reproducing pair). As a byproduct we identify the structure of the frame operator (resp. resolution operator). Moreover, we ask the question, whether there always exist mutually dual systems with the same structure such that the resolution operator is given by the identity, i.e. given $A:X\rightarrow B(\mathcal{H})$, if there exist $ψ,\varphi\in\mathcal{H}$, s.t. \begin{equation*} f=\int_X \langle f,A(x)ψ\rangle A(x)\varphi dμ(x),\ \ \forall f\in \mathcal{H} \end{equation*} and show that the answer is not affirmative. As a counterexample we use a system generated by a unitary action of a subset of the affine Weyl-Heisenberg group in $L^2(\mathbb{R})$. △ Less

Submitted 25 July, 2014; originally announced July 2014.

MSC Class: 22B99; 43A32; 42C15; 42C40

Designing Gabor windows using convex optimization

Authors: Nathanaël Perraudin, Nicki Holighaus, Peter L. Søndergaard, Peter Balazs

Abstract: Redundant Gabor frames admit an infinite number of dual frames, yet only the canonical dual Gabor system, constructed from the minimal l2-norm dual window, is widely used. This window function however, might lack desirable properties, e.g. good time-frequency concentration, small support or smoothness. We employ convex optimization methods to design dual windows satisfying the Wexler-Raz equations… ▽ More Redundant Gabor frames admit an infinite number of dual frames, yet only the canonical dual Gabor system, constructed from the minimal l2-norm dual window, is widely used. This window function however, might lack desirable properties, e.g. good time-frequency concentration, small support or smoothness. We employ convex optimization methods to design dual windows satisfying the Wexler-Raz equations and optimizing various constraints. Numerical experiments suggest that alternate dual windows with considerably improved features can be found. △ Less

Submitted 11 April, 2018; v1 submitted 23 January, 2014; originally announced January 2014.

An operator based approach to irregular frames of translates

Authors: Peter Balazs, Sigrid Heineken

Abstract: We consider translates of functions in $L^2(\RRd)$ along an irregular set of points. Introducing a notion of pseudo-Gramian function for the irregular case, we obtain conditions for a family of irregular translates to be a Bessel sequence or Riesz sequence. We find a representation of the canonical dual of a frame sequence $\{φ( \cdot - λ_k)\}_{k\in \ZZ}$ - where $φ$ is a bandlimited function -… ▽ More We consider translates of functions in $L^2(\RRd)$ along an irregular set of points. Introducing a notion of pseudo-Gramian function for the irregular case, we obtain conditions for a family of irregular translates to be a Bessel sequence or Riesz sequence. We find a representation of the canonical dual of a frame sequence $\{φ( \cdot - λ_k)\}_{k\in \ZZ}$ - where $φ$ is a bandlimited function - in terms of its Fourier transform. △ Less

Submitted 16 July, 2014; v1 submitted 20 January, 2014; originally announced January 2014.

Frames, semi-frames, and Hilbert scales

Authors: J-P. Antoine, P. Balazs

Abstract: Given a total sequence in a Hilbert space, we speak of an upper (resp. lower) semi-frame if only the upper (resp. lower) frame bound is valid. Equivalently, for an upper semi-frame, the frame operator is bounded, but has an unbounded inverse, whereas a lower semi-frame has an unbounded frame operator, with bounded inverse. For upper semi-frames, in the discrete and the continuous case, we build tw… ▽ More Given a total sequence in a Hilbert space, we speak of an upper (resp. lower) semi-frame if only the upper (resp. lower) frame bound is valid. Equivalently, for an upper semi-frame, the frame operator is bounded, but has an unbounded inverse, whereas a lower semi-frame has an unbounded frame operator, with bounded inverse. For upper semi-frames, in the discrete and the continuous case, we build two natural Hilbert scales which may yield a novel characterization of certain function spaces of interest in signal processing. We present some examples and, in addition, some results concerning the duality between lower and upper semi-frames, as well as some generalizations, including fusion semi-frames and Banach semi-frames. △ Less

Submitted 2 March, 2012; originally announced March 2012.

Comments: 27 pages; Numerical Functional Analysis and Optimization, 33 (2012) in press. arXiv admin note: substantial text overlap with arXiv:1101.2859

MSC Class: 42C15; 42C40; 46C50; 47A70; 65T60

Journal ref: Numer. Funct. Anal. Optimiz. 33 (2012) 736-769