Showing 1–12 of 12 results for author: Koller, M

A Versatile Low-Complexity Feedback Scheme for FDD Systems via Generative Modeling

Authors: Nurettin Turan, Benedikt Fesl, Michael Koller, Michael Joham, Wolfgang Utschick

Abstract: We propose a versatile feedback scheme for both single- and multi-user multiple-input multiple-output (MIMO) frequency division duplex (FDD) systems. Particularly, we propose utilizing a Gaussian mixture model (GMM) with a reduced number of parameters for codebook construction, feedback encoding, and precoder design. The GMM is fitted offline at the base station (BS) to uplink training samples to… ▽ More We propose a versatile feedback scheme for both single- and multi-user multiple-input multiple-output (MIMO) frequency division duplex (FDD) systems. Particularly, we propose utilizing a Gaussian mixture model (GMM) with a reduced number of parameters for codebook construction, feedback encoding, and precoder design. The GMM is fitted offline at the base station (BS) to uplink training samples to approximate the channel distribution of all possible mobile terminals (MTs) within the BS cell. Subsequently, a codebook is constructed, with each element based on one GMM component. Extracting directional information from the codebook or exploiting the GMM's sample generation ability facilitates joint precoder design for a multi-user MIMO system using state-of-the-art precoding algorithms. After offloading the GMM to the MTs, they can easily determine their feedback by selecting the index of the GMM component with the highest responsibility for their received pilot signal. This strategy exhibits low complexity and supports parallelization. Simulations demonstrate that the proposed approach outperforms conventional methods, which either estimate the channel and utilize a Lloyd codebook or use a deep neural network to determine the feedback in terms of spectral efficiency or sum-rate. The performance gains can be exploited to deploy systems with fewer pilots or feedback bits. △ Less

Submitted 28 November, 2023; v1 submitted 27 April, 2023; originally announced April 2023.

Comments: Copyright IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See https://www.ieee.org/publications/rights/index.html for more information

On the Mean Square Error Optimal Estimator in One-Bit Quantized Systems

Authors: Benedikt Fesl, Michael Koller, Wolfgang Utschick

Abstract: This paper investigates the mean square error (MSE)-optimal conditional mean estimator (CME) in one-bit quantized systems in the context of channel estimation with jointly Gaussian inputs. We analyze the relationship of the generally nonlinear CME to the linear Bussgang estimator, a well-known method based on Bussgang's theorem. We highlight a novel observation that the Bussgang estimator is equal… ▽ More This paper investigates the mean square error (MSE)-optimal conditional mean estimator (CME) in one-bit quantized systems in the context of channel estimation with jointly Gaussian inputs. We analyze the relationship of the generally nonlinear CME to the linear Bussgang estimator, a well-known method based on Bussgang's theorem. We highlight a novel observation that the Bussgang estimator is equal to the CME for different special cases, including the case of univariate Gaussian inputs and the case of multiple pilot signals in the absence of additive noise prior to the quantization. For the general cases we conduct numerical simulations to quantify the gap between the Bussgang estimator and the CME. This gap increases for higher dimensions and longer pilot sequences. We propose an optimal pilot sequence, motivated by insights from the CME, and derive a novel closed-form expression of the MSE for that case. Afterwards, we find a closed-form limit of the MSE in the asymptotically large number of pilots regime that also holds for the Bussgang estimator. Lastly, we present numerical experiments for various system parameters and for different performance metrics which illuminate the behavior of the optimal channel estimator in the quantized regime. In this context, the well-known stochastic resonance effect that appears in quantized systems can be quantified. △ Less

Submitted 27 April, 2023; v1 submitted 8 December, 2022; originally announced December 2022.

Evaluation of a Gaussian Mixture Model-based Channel Estimator using Measurement Data

Authors: Nurettin Turan, Benedikt Fesl, Moritz Grundei, Michael Koller, Wolfgang Utschick

Abstract: In this work, we use real-world data in order to evaluate and validate a machine learning (ML)-based algorithm for physical layer functionalities. Specifically, we apply a recently introduced Gaussian mixture model (GMM)-based algorithm in order to estimate uplink channels stemming from a measurement campaign. For this estimator, there is an initial (offline) training phase, where a GMM is fitted… ▽ More In this work, we use real-world data in order to evaluate and validate a machine learning (ML)-based algorithm for physical layer functionalities. Specifically, we apply a recently introduced Gaussian mixture model (GMM)-based algorithm in order to estimate uplink channels stemming from a measurement campaign. For this estimator, there is an initial (offline) training phase, where a GMM is fitted onto given channel (training) data. Thereafter, the fitted GMM is used for (online) channel estimation. Our experiments suggest that the GMM estimator learns the intrinsic characteristics of a given base station's whole radio propagation environment. Essentially, this ambient information is captured due to universal approximation properties of the initially fitted GMM. For a large enough number of GMM components, the GMM estimator was shown to approximate the (unknown) mean squared error (MSE)-optimal channel estimator arbitrarily well. In our experiments, the GMM estimator shows significant performance gains compared to approaches that are not able to capture the ambient information. To validate the claim that ambient information is learnt, we generate synthetic channel data using a state-of-the-art channel simulator and train the GMM estimator once on these and once on the real data, and we apply the estimator once to the synthetic and once to the real data. We then observe how providing suitable ambient information in the training phase beneficially impacts the later channel estimation performance. △ Less

Submitted 28 July, 2022; originally announced July 2022.

GMM-based Codebook Construction and Feedback Encoding in FDD Systems

Authors: Nurettin Turan, Michael Koller, Benedikt Fesl, Samer Bazzi, Wen Xu, Wolfgang Utschick

Abstract: We propose a precoder codebook construction and feedback encoding scheme which is based on Gaussian mixture models (GMMs). In an offline phase, the base station (BS) first fits a GMM to uplink (UL) training samples. Thereafter, it designs a codebook in an unsupervised manner by exploiting the GMM's clustering capability. We design one codebook entry per GMM component. After offloading the GMM-but… ▽ More We propose a precoder codebook construction and feedback encoding scheme which is based on Gaussian mixture models (GMMs). In an offline phase, the base station (BS) first fits a GMM to uplink (UL) training samples. Thereafter, it designs a codebook in an unsupervised manner by exploiting the GMM's clustering capability. We design one codebook entry per GMM component. After offloading the GMM-but not the codebook-to the mobile terminal (MT) in the online phase, the MT utilizes the GMM to determine the best fitting codebook entry. To this end, no channel estimation is necessary at the MT. Instead, the MT's observed signal is used to evaluate how responsible each component of the GMM is for the signal. The feedback consists of the index of the GMM component with the highest responsibility and the BS then employs the corresponding codebook entry. Simulation results show that the proposed codebook design and feedback encoding scheme outperforms conventional Lloyd clustering based codebook design algorithms, especially in configurations with reduced pilot overhead. △ Less

Submitted 24 May, 2022; originally announced May 2022.

Variational Autoencoder Leveraged MMSE Channel Estimation

Authors: Michael Baur, Benedikt Fesl, Michael Koller, Wolfgang Utschick

Abstract: We propose to utilize a variational autoencoder (VAE) for data-driven channel estimation. The underlying true and unknown channel distribution is modeled by the VAE as a conditional Gaussian distribution in a novel way, parameterized by the respective first and second order conditional moments. As a result, it can be observed that the linear minimum mean square error (LMMSE) estimator in its varia… ▽ More We propose to utilize a variational autoencoder (VAE) for data-driven channel estimation. The underlying true and unknown channel distribution is modeled by the VAE as a conditional Gaussian distribution in a novel way, parameterized by the respective first and second order conditional moments. As a result, it can be observed that the linear minimum mean square error (LMMSE) estimator in its variant conditioned on the latent sample of the VAE approximates an optimal MSE estimator. Furthermore, we argue how a VAE-based channel estimator can approximate the MMSE channel estimator. We propose three variants of VAE estimators that differ in the data used during training and estimation. First, we show that given perfectly known channel state information at the input of the VAE during estimation, which is impractical, we obtain an estimator that can serve as a benchmark result for an estimation scenario. We then propose practically feasible approaches, where perfectly known channel state information is only necessary in the training phase or is not needed at all. Simulation results on 3GPP and QuaDRiGa channel data attest a small performance loss of the practical approaches and the superiority of our VAE approaches in comparison to other related channel estimation methods. △ Less

Submitted 22 November, 2022; v1 submitted 11 May, 2022; originally announced May 2022.

Comments: Accepted for publication at Asilomar 2022

Channel Estimation based on Gaussian Mixture Models with Structured Covariances

Authors: Benedikt Fesl, Michael Joham, Sha Hu, Michael Koller, Nurettin Turan, Wolfgang Utschick

Abstract: In this work, we propose variations of a Gaussian mixture model (GMM) based channel estimator that was recently proven to be asymptotically optimal in the minimum mean square error (MMSE) sense. We account for the need of low computational complexity in the online estimation and low cost for training and storage in practical applications. To this end, we discuss modifications of the underlying exp… ▽ More In this work, we propose variations of a Gaussian mixture model (GMM) based channel estimator that was recently proven to be asymptotically optimal in the minimum mean square error (MMSE) sense. We account for the need of low computational complexity in the online estimation and low cost for training and storage in practical applications. To this end, we discuss modifications of the underlying expectation-maximization (EM) algorithm, which is needed to fit the parameters of the GMM, to allow for structurally constrained covariances. Further, we investigate splitting the 2D time and frequency estimation problem in wideband systems into cascaded 1D estimations with the help of the GMM. The proposed cascaded GMM approach drastically reduces the complexity and memory requirements. We observe that due to the training on realistic channel data, the proposed GMM estimators seem to inherently perform a trade-off between saving complexity/parameters and estimation performance. We compare these low-complexity approaches to a practical and low cost method that relies on the power delay profile (PDP) and the Doppler spectrum (DS). We argue that, with the training on scenario-specific data from the environment, these practical baselines are outperformed by far with equal estimation complexity. △ Less

Submitted 3 June, 2023; v1 submitted 7 May, 2022; originally announced May 2022.

An Asymptotically MSE-Optimal Estimator based on Gaussian Mixture Models

Authors: Michael Koller, Benedikt Fesl, Nurettin Turan, Wolfgang Utschick

Abstract: This paper investigates a channel estimator based on Gaussian mixture models (GMMs) in the context of linear inverse problems with additive Gaussian noise. We fit a GMM to given channel samples to obtain an analytic probability density function (PDF) which approximates the true channel PDF. Then, a conditional mean estimator (CME) corresponding to this approximating PDF is computed in closed form… ▽ More This paper investigates a channel estimator based on Gaussian mixture models (GMMs) in the context of linear inverse problems with additive Gaussian noise. We fit a GMM to given channel samples to obtain an analytic probability density function (PDF) which approximates the true channel PDF. Then, a conditional mean estimator (CME) corresponding to this approximating PDF is computed in closed form and used as an approximation of the optimal CME based on the true channel PDF. This optimal CME cannot be calculated analytically because the true channel PDF is generally unknown. We present mild conditions which allow us to prove the convergence of the GMM-based CME to the optimal CME as the number of GMM components is increased. Additionally, we investigate the estimator's computational complexity and present simplifications based on common model-based insights. Further, we study the estimator's behavior in numerical experiments including multiple-input multiple-output (MIMO) and wideband systems. △ Less

Submitted 20 July, 2022; v1 submitted 23 December, 2021; originally announced December 2021.

An Asymptotically Optimal Approximation of the Conditional Mean Channel Estimator based on Gaussian Mixture Models

Authors: Michael Koller, Benedikt Fesl, Nurettin Turan, Wolfgang Utschick

Abstract: This paper investigates a channel estimator based on Gaussian mixture models (GMMs). We fit a GMM to given channel samples to obtain an analytic probability density function (PDF) which approximates the true channel PDF. Then, a conditional mean channel estimator corresponding to this approximating PDF is computed in closed form and used as an approximation of the optimal conditional mean estimato… ▽ More This paper investigates a channel estimator based on Gaussian mixture models (GMMs). We fit a GMM to given channel samples to obtain an analytic probability density function (PDF) which approximates the true channel PDF. Then, a conditional mean channel estimator corresponding to this approximating PDF is computed in closed form and used as an approximation of the optimal conditional mean estimator based on the true channel PDF. This optimal estimator cannot be calculated analytically because the true channel PDF is generally not available. To motivate the GMM-based estimator, we show that it converges to the optimal conditional mean estimator as the number of GMM components is increased. In numerical experiments, a reasonable number of GMM components already shows promising estimation results. △ Less

Submitted 22 November, 2021; originally announced November 2021.

CSI Clustering with Variational Autoencoding

Authors: Michael Baur, Michael Würth, Michael Koller, Vlad-Costin Andrei, Wolfgang Utschick

Abstract: The model order of a wireless channel plays an important role for a variety of applications in communications engineering, e.g., it represents the number of resolvable incident wavefronts with non-negligible power incident from a transmitter to a receiver. Areas such as direction of arrival estimation leverage the model order to analyze the multipath components of channel state information. In thi… ▽ More The model order of a wireless channel plays an important role for a variety of applications in communications engineering, e.g., it represents the number of resolvable incident wavefronts with non-negligible power incident from a transmitter to a receiver. Areas such as direction of arrival estimation leverage the model order to analyze the multipath components of channel state information. In this work, we propose to use a variational autoencoder to group unlabeled channel state information with respect to the model order in the variational autoencoder latent space in an unsupervised manner. We validate our approach with simulated 3GPP channel data. Our results suggest that, in order to learn an appropriate clustering, it is crucial to use a more flexible likelihood model for the variational autoencoder decoder than it is usually the case in standard applications. △ Less

Submitted 27 October, 2022; v1 submitted 18 November, 2021; originally announced November 2021.

Learning a Compressive Sensing Matrix with Structural Constraints via Maximum Mean Discrepancy Optimization

Authors: Michael Koller, Wolfgang Utschick

Abstract: We introduce a learning-based algorithm to obtain a measurement matrix for compressive sensing related recovery problems. The focus lies on matrices with a constant modulus constraint which typically represent a network of analog phase shifters in hybrid precoding/combining architectures. We interpret a matrix with restricted isometry property as a map** of points from a high- to a low-dimension… ▽ More We introduce a learning-based algorithm to obtain a measurement matrix for compressive sensing related recovery problems. The focus lies on matrices with a constant modulus constraint which typically represent a network of analog phase shifters in hybrid precoding/combining architectures. We interpret a matrix with restricted isometry property as a map** of points from a high- to a low-dimensional hypersphere. We argue that points on the low-dimensional hypersphere, namely, in the range of the matrix, should be uniformly distributed to increase robustness against measurement noise. This notion is formalized in an optimization problem which uses one of the maximum mean discrepancy metrics in the objective function. Recent success of such metrics in neural network related topics motivate a solution of the problem based on machine learning. Numerical experiments show better performance than random measurement matrices that are generally employed in compressive sensing contexts. Further, we adapt a method from the literature to the constant modulus constraint. This method can also compete with random matrices and it is shown to harmonize well with the proposed learning-based approach if it is used as an initialization. Lastly, we describe how other structural matrix constraints, e.g., a Toeplitz constraint, can be taken into account, too. △ Less

Submitted 14 October, 2021; originally announced October 2021.

Centralized Learning of the Distributed Downlink Channel Estimators in FDD Systems using Uplink Data

Authors: B. Fesl, N. Turan, M. Koller, M. Joham, W. Utschick

Abstract: In this work, we propose a convolutional neural network (CNN) based low-complexity approach for downlink (DL) channel estimation (CE) in frequency division duplex (FDD) systems. In contrast to existing work, we use training data which solely stems from the uplink (UL) domain. This allows to learn the CNN centralized at the base station (BS). After training, the network parameters are offloaded to… ▽ More In this work, we propose a convolutional neural network (CNN) based low-complexity approach for downlink (DL) channel estimation (CE) in frequency division duplex (FDD) systems. In contrast to existing work, we use training data which solely stems from the uplink (UL) domain. This allows to learn the CNN centralized at the base station (BS). After training, the network parameters are offloaded to mobile terminals (MTs) within the coverage area of the BS. The MTs can then obtain channel state information (CSI) of the MIMO channels with the low-complexity CNN estimator. This circumvents the necessity of an infeasible amount of feedback, i.e., acquisition of training data at the user, and the offline training phase at each MT. Numerical results show that the CNN which is trained solely based on UL data performs equally well as the network trained based on DL data. Furthermore, the approach is able to outperform state-of-the-art CE algorithms. △ Less

Submitted 25 May, 2021; v1 submitted 22 May, 2021; originally announced May 2021.

Unsupervised Learning of Adaptive Codebooks for Deep Feedback Encoding in FDD Systems

Authors: Nurettin Turan, Michael Koller, Samer Bazzi, Wen Xu, Wolfgang Utschick

Abstract: In this work, we propose a joint adaptive codebook construction and feedback generation scheme in frequency division duplex (FDD) systems. Both unsupervised and supervised deep learning techniques are used for this purpose. Based on a recently discovered equivalence of uplink (UL) and downlink (DL) channel state information (CSI) in terms of neural network learning, the codebook and associated dee… ▽ More In this work, we propose a joint adaptive codebook construction and feedback generation scheme in frequency division duplex (FDD) systems. Both unsupervised and supervised deep learning techniques are used for this purpose. Based on a recently discovered equivalence of uplink (UL) and downlink (DL) channel state information (CSI) in terms of neural network learning, the codebook and associated deep encoder for feedback signaling is based on UL data only. Subsequently, the feedback encoder can be offloaded to the mobile terminals (MTs) to generate channel feedback there as efficiently as possible, without any training effort at the terminals or corresponding transfer of training and codebook data. Numerical simulations demonstrate the promising performance of the proposed method. △ Less

Submitted 21 May, 2021; v1 submitted 19 May, 2021; originally announced May 2021.