Showing 1–50 of 59 results for author: Vorobyov, S A

AdaBoost-Based Efficient Channel Estimation and Data Detection in One-Bit Massive MIMO

Authors: Majdoddin Esfandiari, Sergiy A. Vorobyov, Robert W. Heath Jr

Abstract: The use of one-bit analog-to-digital converter (ADC) has been considered as a viable alternative to high resolution counterparts in realizing and commercializing massive multiple-input multiple-output (MIMO) systems. However, the issue of discarding the amplitude information by one-bit quantizers has to be compensated. Thus, carefully tailored methods need to be developed for one-bit channel estim… ▽ More The use of one-bit analog-to-digital converter (ADC) has been considered as a viable alternative to high resolution counterparts in realizing and commercializing massive multiple-input multiple-output (MIMO) systems. However, the issue of discarding the amplitude information by one-bit quantizers has to be compensated. Thus, carefully tailored methods need to be developed for one-bit channel estimation and data detection as the conventional ones cannot be used. To address these issues, the problems of one-bit channel estimation and data detection for MIMO orthogonal frequency division multiplexing (OFDM) system that operates over uncorrelated frequency selective channels are investigated here. We first develop channel estimators that exploit Gaussian discriminant analysis (GDA) classifier and approximated versions of it as the so-called weak classifiers in an adaptive boosting (AdaBoost) approach. Particularly, the combination of the approximated GDA classifiers with AdaBoost offers the benefit of scalability with the linear order of computations, which is critical in massive MIMO-OFDM systems. We then take advantage of the same idea for proposing the data detectors. Numerical results validate the efficiency of the proposed channel estimators and data detectors compared to other methods. They show comparable/better performance to that of the state-of-the-art methods, but require dramatically lower computational complexities and run times. △ Less

Submitted 1 March, 2024; originally announced March 2024.

An Efficient Approximate Method for Online Convolutional Dictionary Learning

Authors: Farshad G. Veshki, Sergiy A. Vorobyov

Abstract: Most existing convolutional dictionary learning (CDL) algorithms are based on batch learning, where the dictionary filters and the convolutional sparse representations are optimized in an alternating manner using a training dataset. When large training datasets are used, batch CDL algorithms become prohibitively memory-intensive. An online-learning technique is used to reduce the memory requiremen… ▽ More Most existing convolutional dictionary learning (CDL) algorithms are based on batch learning, where the dictionary filters and the convolutional sparse representations are optimized in an alternating manner using a training dataset. When large training datasets are used, batch CDL algorithms become prohibitively memory-intensive. An online-learning technique is used to reduce the memory requirements of CDL by optimizing the dictionary incrementally after finding the sparse representations of each training sample. Nevertheless, learning large dictionaries using the existing online CDL (OCDL) algorithms remains highly computationally expensive. In this paper, we present a novel approximate OCDL method that incorporates sparse decomposition of the training samples. The resulting optimization problems are addressed using the alternating direction method of multipliers. Extensive experimental evaluations using several image datasets show that the proposed method substantially reduces computational costs while preserving the effectiveness of the state-of-the-art OCDL algorithms. △ Less

Submitted 25 January, 2023; originally announced January 2023.

Twenty-Five Years of Advances in Beamforming: From Convex and Nonconvex Optimization to Learning Techniques

Authors: Ahmet M. Elbir, Kumar Vijay Mishra, Sergiy A. Vorobyov, Robert W. Heath Jr

Abstract: Beamforming is a signal processing technique to steer, shape, and focus an electromagnetic wave using an array of sensors toward a desired direction. It has been used in several engineering applications such as radar, sonar, acoustics, astronomy, seismology, medical imaging, and communications. With the advances in multi-antenna technologies largely for radar and communications, there has been a g… ▽ More Beamforming is a signal processing technique to steer, shape, and focus an electromagnetic wave using an array of sensors toward a desired direction. It has been used in several engineering applications such as radar, sonar, acoustics, astronomy, seismology, medical imaging, and communications. With the advances in multi-antenna technologies largely for radar and communications, there has been a great interest on beamformer design mostly relying on convex/nonconvex optimization. Recently, machine learning is being leveraged for obtaining attractive solutions to more complex beamforming problems. This article captures the evolution of beamforming in the last twenty-five years from convex-to-nonconvex optimization and optimization-to-learning approaches. It provides a glimpse of this important signal processing technique into a variety of transmit-receive architectures, propagation zones, paths, and conventional/emerging applications. △ Less

Submitted 22 March, 2023; v1 submitted 3 November, 2022; originally announced November 2022.

Comments: Accepted Paper in IEEE Signal Processing Magazine Special Issue on the 75th Anniversary of IEEE Signal Processing Society

Journal ref: IEEE Signal Processing Magazine 2023 Volume 40 , Issue 4

Convolutional Simultaneous Sparse Approximation with Applications to RGB-NIR Image Fusion

Authors: Farshad G. Veshki, Sergiy A. Vorobyov

Abstract: Simultaneous sparse approximation (SSA) seeks to represent a set of dependent signals using sparse vectors with identical supports. The SSA model has been used in various signal and image processing applications involving multiple correlated input signals. In this paper, we propose algorithms for convolutional SSA (CSSA) based on the alternating direction method of multipliers. Specifically, we ad… ▽ More Simultaneous sparse approximation (SSA) seeks to represent a set of dependent signals using sparse vectors with identical supports. The SSA model has been used in various signal and image processing applications involving multiple correlated input signals. In this paper, we propose algorithms for convolutional SSA (CSSA) based on the alternating direction method of multipliers. Specifically, we address the CSSA problem with different sparsity structures and the convolutional feature learning problem in multimodal data/signals based on the SSA model. We evaluate the proposed algorithms by applying them to multimodal and multifocus image fusion problems. △ Less

Submitted 18 March, 2022; originally announced March 2022.

Graph Convolutional Neural Networks Sensitivity under Probabilistic Error Model

Authors: Xinjue Wang, Esa Ollila, Sergiy A. Vorobyov

Abstract: Graph Neural Networks (GNNs), particularly Graph Convolutional Neural Networks (GCNNs), have emerged as pivotal instruments in machine learning and signal processing for processing graph-structured data. This paper proposes an analysis framework to investigate the sensitivity of GCNNs to probabilistic graph perturbations, directly impacting the graph shift operator (GSO). Our study establishes tig… ▽ More Graph Neural Networks (GNNs), particularly Graph Convolutional Neural Networks (GCNNs), have emerged as pivotal instruments in machine learning and signal processing for processing graph-structured data. This paper proposes an analysis framework to investigate the sensitivity of GCNNs to probabilistic graph perturbations, directly impacting the graph shift operator (GSO). Our study establishes tight expected GSO error bounds, which are explicitly linked to the error model parameters, and reveals a linear relationship between GSO perturbations and the resulting output differences at each layer of GCNNs. This linearity demonstrates that a single-layer GCNN maintains stability under graph edge perturbations, provided that the GSO errors remain bounded, regardless of the perturbation scale. For multilayer GCNNs, the dependency of system's output difference on GSO perturbations is shown to be a recursion of linearity. Finally, we exemplify the framework with the Graph Isomorphism Network (GIN) and Simple Graph Convolution Network (SGCN). Experiments validate our theoretical derivations and the effectiveness of our approach. △ Less

Submitted 6 May, 2024; v1 submitted 15 March, 2022; originally announced March 2022.

Efficient ADMM-based Algorithms for Convolutional Sparse Coding

Authors: Farshad G. Veshki, Sergiy A. Vorobyov

Abstract: Convolutional sparse coding improves on the standard sparse approximation by incorporating a global shift-invariant model. The most efficient convolutional sparse coding methods are based on the alternating direction method of multipliers and the convolution theorem. The only major difference between these methods is how they approach a convolutional least-squares fitting subproblem. This letter p… ▽ More Convolutional sparse coding improves on the standard sparse approximation by incorporating a global shift-invariant model. The most efficient convolutional sparse coding methods are based on the alternating direction method of multipliers and the convolution theorem. The only major difference between these methods is how they approach a convolutional least-squares fitting subproblem. This letter presents a solution to this subproblem, which improves the efficiency of the state-of-the-art algorithms. We also use the same approach for develo** an efficient convolutional dictionary learning method. Furthermore, we propose a novel algorithm for convolutional sparse coding with a constraint on the approximation error. △ Less

Submitted 7 September, 2021; originally announced September 2021.

Coupled Feature Learning for Multimodal Medical Image Fusion

Authors: Farshad G. Veshki, Nora Ouzir, Sergiy A. Vorobyov, Esa Ollila

Abstract: Multimodal image fusion aims to combine relevant information from images acquired with different sensors. In medical imaging, fused images play an essential role in both standard and automated diagnosis. In this paper, we propose a novel multimodal image fusion method based on coupled dictionary learning. The proposed method is general and can be employed for different medical imaging modalities.… ▽ More Multimodal image fusion aims to combine relevant information from images acquired with different sensors. In medical imaging, fused images play an essential role in both standard and automated diagnosis. In this paper, we propose a novel multimodal image fusion method based on coupled dictionary learning. The proposed method is general and can be employed for different medical imaging modalities. Unlike many current medical fusion methods, the proposed approach does not suffer from intensity attenuation nor loss of critical information. Specifically, the images to be fused are decomposed into coupled and independent components estimated using sparse representations with identical supports and a Pearson correlation constraint, respectively. An alternating minimization algorithm is designed to solve the resulting optimization problem. The final fusion step uses the max-absolute-value rule. Experiments are conducted using various pairs of multimodal inputs, including real MR-CT and MR-PET images. The resulting performance and execution times show the competitiveness of the proposed method in comparison with state-of-the-art medical image fusion methods. △ Less

Submitted 17 February, 2021; originally announced February 2021.

DOA Estimation for Transmit Beamspace MIMO Radar via Tensor Decomposition with Vandermonde Factor Matrix

Authors: Feng Xu, Matthew W. Morency, Sergiy A. Vorobyov

Abstract: We address the problem of tensor decomposition in application to direction-of-arrival (DOA) estimation for transmit beamspace (TB) multiple-input multiple-output (MIMO) radar. A general 4-order tensor model that enables computationally efficient DOA estimation is designed. Whereas other tensor decomposition-based methods treat all factor matrices as arbitrary, the essence of the proposed DOA estim… ▽ More We address the problem of tensor decomposition in application to direction-of-arrival (DOA) estimation for transmit beamspace (TB) multiple-input multiple-output (MIMO) radar. A general 4-order tensor model that enables computationally efficient DOA estimation is designed. Whereas other tensor decomposition-based methods treat all factor matrices as arbitrary, the essence of the proposed DOA estimation method is to fully exploit the Vandermonde structure of the factor matrices to take advantage of the shift-invariance between and within different subarrays. Specifically, the received signal of TB MIMO radar is expressed as a 4-order tensor. Depending on the target Doppler shifts, the constructed tensor is reshaped into two distinct 3-order tensors. A computationally efficient tensor decomposition method is proposed to decompose the Vandermonde factor matrices. The generators of the Vandermonde factor matrices are computed to estimate the phase rotations between subarrays, which can be utilized as a look-up table for finding target DOA. It is further shown that our proposed method can be used in a more general scenario where the subarray structures can be arbitrary but identical. The proposed DOA estimation method requires no prior information about the tensor rank and is guaranteed to achieve precise decomposition result. Simulation results illustrate the performance improvement of the proposed DOA estimation method as compared to conventional DOA estimation techniques for TB MIMO Radar. △ Less

Submitted 29 January, 2021; originally announced January 2021.

Comments: 14 pages, 9 figures, submitted to IEEE Transactions on Signal Processing

Graph Signal Processing Meets Blind Source Separation

Authors: Jari Miettinen, Eyal Nitzan, Sergiy A. Vorobyov, Esa Ollila

Abstract: In graph signal processing (GSP), prior information on the dependencies in the signal is collected in a graph which is then used when processing or analyzing the signal. Blind source separation (BSS) techniques have been developed and analyzed in different domains, but for graph signals the research on BSS is still in its infancy. In this paper, this gap is filled with two contributions. First, a… ▽ More In graph signal processing (GSP), prior information on the dependencies in the signal is collected in a graph which is then used when processing or analyzing the signal. Blind source separation (BSS) techniques have been developed and analyzed in different domains, but for graph signals the research on BSS is still in its infancy. In this paper, this gap is filled with two contributions. First, a nonparametric BSS method, which is relevant to the GSP framework, is refined, the Cramér-Rao bound (CRB) for mixing and unmixing matrix estimators in the case of Gaussian moving average graph signals is derived, and for studying the achievability of the CRB, a new parametric method for BSS of Gaussian moving average graph signals is introduced. Second, we also consider BSS of non-Gaussian graph signals and two methods are proposed. Identifiability conditions show that utilizing both graph structure and non-Gaussianity provides a more robust approach than methods which are based on only either graph dependencies or non-Gaussianity. It is also demonstrated by numerical study that the proposed methods are more efficient in separating non-Gaussian graph signals. △ Less

Submitted 24 August, 2020; originally announced August 2020.

Comments: 31 pages, 3 figures, 1 table, submitted to IEEE Trans. Signal Processing on Aug. 2020

Journal ref: IEEE Trans. Signal Processing, vol. 69, pp. 2585-2599, May 2021

Joint DOD and DOA Estimation in Slow-Time MIMO Radar via PARAFAC Decomposition

Authors: Feng Xu, Sergiy A. Vorobyov, Xiaopeng Yang

Abstract: We develop a new tensor model for slow-time multiple-input multiple output (MIMO) radar and apply it for joint direction-of-departure (DOD) and direction-of-arrival (DOA) estimation. This tensor model aims to exploit the independence of phase modulation matrix and receive array in the received signal for slow-time MIMO radar. Such tensor can be decomposed into two tensors of different ranks, one o… ▽ More We develop a new tensor model for slow-time multiple-input multiple output (MIMO) radar and apply it for joint direction-of-departure (DOD) and direction-of-arrival (DOA) estimation. This tensor model aims to exploit the independence of phase modulation matrix and receive array in the received signal for slow-time MIMO radar. Such tensor can be decomposed into two tensors of different ranks, one of which has identical structure to that of the conventional tensor model for MIMO radar, and the other contains all phase modulation values used in the transmit array. We then develop a modification of the alternating least squares algorithm to enable parallel factor decomposition of tensors with extra constants. The Vandermonde structure of the transmit and receive steering matrices (if both arrays are uniform and linear) is then utilized to obtain angle estimates from factor matrices. The multi-linear structure of the received signal is maintained to take advantage of tensor-based angle estimation algorithms, while the shortage of samples in Doppler domain for slow-time MIMO radar is mitigated. As a result, the joint DOD and DOA estimation performance is improved as compared to existing angle estimation techniques for slow-time MIMO radar. Simulation results verify the effectiveness of the proposed method. △ Less

Submitted 30 July, 2020; originally announced July 2020.

Comments: 6 double-column pages, 4 figures, submitted IEEE Signal Processing Letters

Journal ref: IEEE Signal Processing Letters, vol. 27, pp. 1495-1499, 2020

Lossless Size Reduction for Integer Least Squares with Application to Sphere Decoding

Authors: Mohammad Neinavaie, Mostafa Derakhtian, Sergiy A. Vorobyov

Abstract: Minimum achievable complexity (MAC) for a maximum likelihood (ML) performance-achieving detection algorithm is derived. Using the derived MAC, we prove that the conventional sphere decoding (SD) algorithms suffer from an inherent weakness at low SNRs. To find a solution for the low SNR deficiency, we analyze the effect of zero-forcing (ZF) and minimum mean square error (MMSE) detected symbols on t… ▽ More Minimum achievable complexity (MAC) for a maximum likelihood (ML) performance-achieving detection algorithm is derived. Using the derived MAC, we prove that the conventional sphere decoding (SD) algorithms suffer from an inherent weakness at low SNRs. To find a solution for the low SNR deficiency, we analyze the effect of zero-forcing (ZF) and minimum mean square error (MMSE) detected symbols on the MAC and demonstrate that although they both improve the SD algorithm in terms of the computational complexity, the MMSE point has a vital difference at low SNRs. By exploiting the information provided by the MMSE method, we prove the existence of a lossless size reduction which can be interpreted as the feasibility of a detection method which is capable of detecting the ML symbol without visiting any nodes at low and high SNRs. We also propose a lossless size reduction-aided detection method which achieves the promised complexity bounds marginally and reduces the overall computational complexity significantly, while obtaining the ML performance. The theoretical analysis is corroborated with numerical simulations. △ Less

Submitted 29 November, 2019; originally announced November 2019.

Comments: 13 double column pages, 8 figures, submitted to IEEE Trans. Signal Processing in November 2019

Journal ref: IEEE Trans. Signal Processing, vol. 68, pp. 6547-6561, Dec. 2020

A Fast Dictionary Learning Method for Coupled Feature Space Learning

Authors: F. G. Veshki, S. A. Vorobyov

Abstract: In this letter, we propose a novel computationally efficient coupled dictionary learning method that enforces pairwise correlation between the atoms of dictionaries learned to represent the underlying feature spaces of two different representations of the same signals, e.g., representations in different modalities or representations of the same signals measured with different qualities. The jointl… ▽ More In this letter, we propose a novel computationally efficient coupled dictionary learning method that enforces pairwise correlation between the atoms of dictionaries learned to represent the underlying feature spaces of two different representations of the same signals, e.g., representations in different modalities or representations of the same signals measured with different qualities. The jointly learned correlated feature spaces represented by coupled dictionaries are used in sparse representation based classification, recognition and reconstruction tasks. The presented experimental results show that the proposed coupled dictionary learning method has a significantly lower computational cost. Moreover, the visual presentation of jointly learned dictionaries shows that the pairwise correlations between the corresponding atoms are ensured. △ Less

Submitted 15 April, 2019; originally announced April 2019.

Comments: 12 pages, 3 figures, 1 algorithm

Journal ref: IEEE Signal Processing Letters, vol. 26, no. 10, pp. 1441-1445, Oct. 2019

Adaptive Virtual Waveform Design for Millimeter-Wave Joint Communication-Radar

Authors: Preeti Kumari, Sergiy A. Vorobyov, Robert W. Heath Jr

Abstract: Joint communication and radar (JCR) waveforms with fully digital baseband generation and processing can now be realized at the millimeter-wave (mmWave) band. Prior work has proposed a mmWave wireless local area network (WLAN)-based JCR that exploits the WLAN preamble for radars. The performance of target velocity estimation, however, was limited. In this paper, we propose a virtual waveform design… ▽ More Joint communication and radar (JCR) waveforms with fully digital baseband generation and processing can now be realized at the millimeter-wave (mmWave) band. Prior work has proposed a mmWave wireless local area network (WLAN)-based JCR that exploits the WLAN preamble for radars. The performance of target velocity estimation, however, was limited. In this paper, we propose a virtual waveform design for an adaptive mmWave JCR. The proposed system transmits a few non-uniformly placed preambles to construct several receive virtual preambles for enhancing velocity estimation accuracy, at the cost of only a small reduction in the communication data rate. We evaluate JCR performance trade-offs using the Cramer-Rao Bound (CRB) metric for radar estimation and a novel distortion minimum mean square error (MMSE) metric for data communication. Additionally, we develop three different MMSE-based optimization problems for the adaptive JCR waveform design. Simulations show that an optimal virtual (non-uniform) waveform achieves a significant performance improvement as compared to a uniform waveform. For a radar CRB constrained optimization, the optimal radar range of operation and the optimal communication distortion MMSE (DMMSE) are improved. For a communication DMMSE constrained optimization with a high DMMSE constraint, the optimal radar CRB is enhanced. For a weighted MMSE average optimization, the advantage of the virtual waveform over the uniform waveform is increased with decreased communication weighting. Comparison of MMSE-based optimization with traditional virtual preamble count-based optimization indicated that the conventional solution converges to the MMSE-based one only for a small number of targets and a high signal-to-noise ratio. △ Less

Submitted 10 April, 2019; originally announced April 2019.

Journal ref: IEEE Trans. Signal Processing, vol. 68, pp. 715-730, 2020

On the Spectral Efficiency for Massive MIMO Systems With Imperfect Spacial Covariance Information

Authors: A. K. Kocharlakota, K. Upadhya, S. A. Vorobyov

Abstract: This paper studies the impact of imperfect channel covariance information on the uplink (UL) and downlink (DL) spectral efficiencies (SEs) of a time-division duplexed (TDD) massive multiple-input multiple-output (MIMO) system. We derive closed-form expressions for the UL and DL average SEs by considering linear minimum mean squared (LMMSE)-type and element-wise LMMSE-type channel estimation that r… ▽ More This paper studies the impact of imperfect channel covariance information on the uplink (UL) and downlink (DL) spectral efficiencies (SEs) of a time-division duplexed (TDD) massive multiple-input multiple-output (MIMO) system. We derive closed-form expressions for the UL and DL average SEs by considering linear minimum mean squared (LMMSE)-type and element-wise LMMSE-type channel estimation that represent LMMSE and element-wise LMMSE with estimated covariance matrices, respectively. The closed-form expressions of these average SEs are functions of the number of observations used for estimating the spatial covariance matrices of individual and contaminated channels of a target user, and thus enable us to select these key parameters to achieve the desired SE. We present a theoretical analysis of SE behavior for different values of these parameters, followed by simulations, which also demonstrate and validate this behavior. Specifically, we present the SEs computed using estimated covariance matrices and show the accurate agreement between the theoretical and simulated SEs as functions of the number of observations for estimating the covariance matrices of individual and contaminated channels of a user. We also compare these SEs across channel estimation techniques using analytical and simulation studies. △ Less

Submitted 12 September, 2019; v1 submitted 28 March, 2019; originally announced March 2019.

Comments: 30 pages, 7 figures, Submitted to IEEE Trans. Wireless Communications on March 2019

Non-Iterative Subspace-Based DOA Estimation in the Presence of Nonuniform Noise

Authors: M. Esfandiari, S. A. Vorobyov, S. Aliban, M. Karimi

Abstract: The uniform white noise assumption is one of the basic assumptions in most of the existing directional-of-arrival (DOA) estimation methods. In many applications, however, the non-uniform white noise model is more adequate. Then the noise variances at different sensors have to be also estimated as nuisance parameters while estimating DOAs. In this letter, different from the existing iterative metho… ▽ More The uniform white noise assumption is one of the basic assumptions in most of the existing directional-of-arrival (DOA) estimation methods. In many applications, however, the non-uniform white noise model is more adequate. Then the noise variances at different sensors have to be also estimated as nuisance parameters while estimating DOAs. In this letter, different from the existing iterative methods that address the problem of non-uniform noise, a non-iterative two-phase subspace-based DOA estimation method is proposed. The first phase of the method is based on estimating the noise subspace via eigendecomposition (ED) of some properly designed matrix and it avoids estimating the noise covariance matrix. In the second phase, the results achieved in the first phase are used to estimate the noise covariance matrix, followed by estimating the noise subspace via generalized ED. Since the proposed method estimates DOAs in a non-iterative manner, it is computationally more efficient and has no convergence issues as compared to the existing methods. Simulation results demonstrate better performance of the proposed method as compared to other existing state-of-the-art methods. △ Less

Submitted 27 March, 2019; originally announced March 2019.

Comments: 12 pages, 2 figures, 1 table. Accepted for publication in IEEE Signal Processing Letters

Journal ref: IEEE Signal Processing Letters, vol. 26, no. 6, pp. 848-852, June 2019

Modelling Graph Errors: Towards Robust Graph Signal Processing

Authors: Jari Miettinen, Sergiy A. Vorobyov, Esa Ollila

Abstract: The first step for any graph signal processing (GSP) procedure is to learn the graph signal representation, i.e., to capture the dependence structure of the data into an adjacency matrix. Indeed, the adjacency matrix is typically not known a priori and has to be learned. However, it is learned with errors. A little attention has been paid to modelling such errors in the adjacency matrix, and study… ▽ More The first step for any graph signal processing (GSP) procedure is to learn the graph signal representation, i.e., to capture the dependence structure of the data into an adjacency matrix. Indeed, the adjacency matrix is typically not known a priori and has to be learned. However, it is learned with errors. A little attention has been paid to modelling such errors in the adjacency matrix, and studying their effects on GSP methods. However, modelling errors in the adjacency matrix will enable both to study the graph error effects in GSP and to develop robust GSP algorithms. In this paper, we therefore introduce practically justifiable graph error models. We also study, both analytically when possible and numerically, the graph error effect on the performance of GSP methods in different types of problems such as filtering of graph signals and independent component analysis of graph signals (graph decorrelation). △ Less

Submitted 25 September, 2020; v1 submitted 20 March, 2019; originally announced March 2019.

Comments: 34 pages, 6 figures, 2 tables, Submitted to IEEE journal on January 2019

Journal ref: Signal Processing, vol. 189, 108256, pp. 1-8, Dec. 2021

Joint Detection and Localization of an Unknown Number of Sources Using Algebraic Structure of the Noise Subspace

Authors: Matthew W. Morency, Sergiy A. Vorobyov, Geert Leus

Abstract: Source localization and spectral estimation are among the most fundamental problems in statistical and array signal processing. Methods which rely on the orthogonality of the signal and noise subspaces, such as Pisarenko's method, MUSIC, and root-MUSIC are some of the most widely used algorithms to solve these problems. As a common feature, these methods require both apriori knowledge of the numbe… ▽ More Source localization and spectral estimation are among the most fundamental problems in statistical and array signal processing. Methods which rely on the orthogonality of the signal and noise subspaces, such as Pisarenko's method, MUSIC, and root-MUSIC are some of the most widely used algorithms to solve these problems. As a common feature, these methods require both apriori knowledge of the number of sources, and an estimate of the noise subspace. Both requirements are complicating factors to the practical implementation of the algorithms, and when not satisfied exactly, can potentially lead to severe errors. In this paper, we propose a new localization criterion based on the algebraic structure of the noise subspace that is described for the first time to the best of our knowledge. Using this criterion and the relationship between the source localization problem and the problem of computing the greatest common divisor (GCD), or more practically approximate GCD, for polynomials, we propose two algorithms which adaptively learn the number of sources and estimate their locations. Simulation results show a significant improvement over root-MUSIC in challenging scenarios such as closely located sources, both in terms of detection of the number of sources and their localization over a broad and practical range of SNRs. Further, no performance sacrifice in simple scenarios is observed. △ Less

Submitted 22 May, 2018; originally announced May 2018.

Comments: 16 two-column pages, 12 figures, 1 table, Submitted for publication in IEEE Trans. Signal Processing

Journal ref: IEEE Trans. Signal Processing, vol. 66, no. 17, pp. 4685-4700, Sept. 2018

Covariance Matrix Estimation for Massive MIMO

Authors: Karthik Upadhya, Sergiy A. Vorobyov

Abstract: We propose a novel pilot structure for covariance matrix estimation in massive multiple-input multiple-output (MIMO) systems in which each user transmits two pilot sequences, with the second pilot sequence multiplied by a random phase-shift. The covariance matrix of a particular user is obtained by computing the sample cross-correlation of the channel estimates obtained from the two pilot sequence… ▽ More We propose a novel pilot structure for covariance matrix estimation in massive multiple-input multiple-output (MIMO) systems in which each user transmits two pilot sequences, with the second pilot sequence multiplied by a random phase-shift. The covariance matrix of a particular user is obtained by computing the sample cross-correlation of the channel estimates obtained from the two pilot sequences. This approach relaxes the requirement that all the users transmit their uplink pilots over the same set of symbols. We derive expressions for the achievable rate and the mean-squared error of the covariance matrix estimate when the proposed method is used with staggered pilots. The performance of the proposed method is compared with existing methods through simulations. △ Less

Submitted 7 March, 2018; v1 submitted 5 February, 2018; originally announced February 2018.

Comments: 6 pages, 4 figures. Accepted for publication in IEEE Signal Processing Letters

Journal ref: K. Upadhya and S.A. Vorobyov, "Covariance matrix estimation for massive MIMO," IEEE Signal Processing Letters, vol. 25, no. 4, pp. 546-550, Apr. 2018

Multi-Focus Image Fusion Using Sparse Representation and Coupled Dictionary Learning

Authors: Farshad G. Veshki, Sergiy A. Vorobyov

Abstract: We address the multi-focus image fusion problem, where multiple images captured with different focal settings are to be fused into an all-in-focus image of higher quality. Algorithms for this problem necessarily admit the source image characteristics along with focused and blurred features. However, most sparsity-based approaches use a single dictionary in focused feature space to describe multi-f… ▽ More We address the multi-focus image fusion problem, where multiple images captured with different focal settings are to be fused into an all-in-focus image of higher quality. Algorithms for this problem necessarily admit the source image characteristics along with focused and blurred features. However, most sparsity-based approaches use a single dictionary in focused feature space to describe multi-focus images, and ignore the representations in blurred feature space. We propose a multi-focus image fusion approach based on sparse representation using a coupled dictionary. It exploits the observations that the patches from a given training set can be sparsely represented by a couple of overcomplete dictionaries related to the focused and blurred categories of images and that a sparse approximation based on such coupled dictionary leads to a more flexible and therefore better fusion strategy than the one based on just selecting the sparsest representation in the original image estimate. In addition, to improve the fusion performance, we employ a coupled dictionary learning approach that enforces pairwise correlation between atoms of dictionaries learned to represent the focused and blurred feature spaces. We also discuss the advantages of the fusion approach based on coupled dictionary learning, and present efficient algorithms for fusion based on coupled dictionary learning. Extensive experimental comparisons with state-of-the-art multi-focus image fusion algorithms validate the effectiveness of the proposed approach. △ Less

Submitted 3 May, 2019; v1 submitted 30 May, 2017; originally announced May 2017.

Comments: 25 pages, 15 figures, 2 table

Transmit Array Interpolation for DOA Estimation via Tensor Decomposition in 2D MIMO Radar

Authors: Ming-Yang Cao, Sergiy A. Vorobyov, Aboulnasr Hassanien

Abstract: In this paper, we propose a two-dimensional (2D) joint transmit array interpolation and beamspace design for planar array mono-static multiple-input-multiple-output (MIMO) radar for direction-of-arrival (DOA) estimation via tensor modeling. Our underlying idea is to map the transmit array to a desired array and suppress the transmit power outside the spatial sector of interest. In doing so, the si… ▽ More In this paper, we propose a two-dimensional (2D) joint transmit array interpolation and beamspace design for planar array mono-static multiple-input-multiple-output (MIMO) radar for direction-of-arrival (DOA) estimation via tensor modeling. Our underlying idea is to map the transmit array to a desired array and suppress the transmit power outside the spatial sector of interest. In doing so, the signal-tonoise ratio is improved at the receive array. Then, we fold the received data along each dimension into a tensorial structure and apply tensor-based methods to obtain DOA estimates. In addition, we derive a close-form expression for DOA estimation bias caused by interpolation errors and argue for using a specially designed look-up table to compensate the bias. The corresponding Cramer-Rao Bound (CRB) is also derived. Simulation results are provided to show the performance of the proposed method and compare its performance to CRB. △ Less

Submitted 5 May, 2017; originally announced May 2017.

Comments: 37 pages, 13 figures, Submitted to the IEEE Trans. Signal Processing in December 2016

Journal ref: IEEE Transaction on Signal Processing, vol. 65, no. 19, pp. 5225-5239, Oct. 2017

Image Fusion With Cosparse Analysis Operator

Authors: Rui Gao, Sergiy A. Vorobyov, Hong Zhao

Abstract: The paper addresses the image fusion problem, where multiple images captured with different focus distances are to be combined into a higher quality all-in-focus image. Most current approaches for image fusion strongly rely on the unrealistic noise-free assumption used during the image acquisition, and then yield limited robustness in fusion processing. In our approach, we formulate the multi-focu… ▽ More The paper addresses the image fusion problem, where multiple images captured with different focus distances are to be combined into a higher quality all-in-focus image. Most current approaches for image fusion strongly rely on the unrealistic noise-free assumption used during the image acquisition, and then yield limited robustness in fusion processing. In our approach, we formulate the multi-focus image fusion problem in terms of an analysis sparse model, and simultaneously perform the restoration and fusion of multi-focus images. Based on this model, we propose an analysis operator learning, and define a novel fusion function to generate an all-in-focus image. Experimental evaluations confirm the effectiveness of the proposed fusion approach both visually and quantitatively, and show that our approach outperforms state-of-the-art fusion methods. △ Less

Submitted 18 April, 2017; originally announced April 2017.

Comments: 12 pages, 4 figures, 1 table, Submitted to IEEE Signal Processing Letters on December 2016

Journal ref: IEEE Signal Processing Letters, vol. 24, no. 7, pp. 943-947, July 2017

Fast Algorithms for Designing Multiple Unimodular Waveforms With Good Correlation Properties

Authors: Yongzhe Li, Sergiy A. Vorobyov

Abstract: In this paper, we develop new fast and efficient algorithms for designing single/multiple unimodular waveforms/codes with good auto- and cross-correlation or weighted correlation properties, which are highly desired in radar and communication systems. The waveform design is based on the minimization of the integrated sidelobe level (ISL) and weighted ISL (WISL) of waveforms. As the corresponding o… ▽ More In this paper, we develop new fast and efficient algorithms for designing single/multiple unimodular waveforms/codes with good auto- and cross-correlation or weighted correlation properties, which are highly desired in radar and communication systems. The waveform design is based on the minimization of the integrated sidelobe level (ISL) and weighted ISL (WISL) of waveforms. As the corresponding optimization problems can quickly grow to large scale with increasing the code length and number of waveforms, the main issue turns to be the development of fast large-scale optimization techniques. The difficulty is also that the corresponding optimization problems are non-convex, but the required accuracy is high. Therefore, we formulate the ISL and WISL minimization problems as non-convex quartic optimization problems in frequency domain, and then simplify them into quadratic problems by utilizing the majorization-minimization technique, which is one of the basic techniques for addressing large-scale and/or non-convex optimization problems. While designing our fast algorithms, we find out and use inherent algebraic structures in the objective functions to rewrite them into quartic forms, and in the case of WISL minimization, to derive additionally an alternative quartic form which allows to apply the quartic-quadratic transformation. Our algorithms are applicable to large-scale unimodular waveform design problems as they are proved to have lower or comparable computational burden (analyzed theoretically) and faster convergence speed (confirmed by comprehensive simulations) than the state-of-the-art algorithms. In addition, the waveforms designed by our algorithms demonstrate better correlation properties compared to their counterparts. △ Less

Submitted 22 February, 2017; originally announced February 2017.

Comments: 30 pages, 3 figures

Journal ref: IEEE Transactions on Signal Processing. vol. 66, no. 5, pp. 1197-1212, Mar. 2018

An Algebraic Approach to a Class of Rank-Constrained Semi-Definite Programs With Applications

Authors: Matthew W. Morency, Sergiy A. Vorobyov

Abstract: A new approach to solving a class of rankconstrained semi-definite programming (SDP) problems, which appear in many signal processing applications such as transmit beamspace design in multiple-input multiple-output (MIMO) radar, downlink beamforming design in MIMO communications, generalized sidelobe canceller design, phase retrieval, etc., is presented. The essence of the approach is the use of u… ▽ More A new approach to solving a class of rankconstrained semi-definite programming (SDP) problems, which appear in many signal processing applications such as transmit beamspace design in multiple-input multiple-output (MIMO) radar, downlink beamforming design in MIMO communications, generalized sidelobe canceller design, phase retrieval, etc., is presented. The essence of the approach is the use of underlying algebraic structure enforced in such problems by other practical constraints such as, for example, null sha** constraint. According to this approach, instead of relaxing the non-convex rankconstrained SDP problem to a feasible set of positive semidefinite matrices, we restrict it to a space of polynomials whose dimension is equal to the desired rank. The resulting optimization problem is then convex as its solution is required to be full rank, and can be efficiently and exactly solved. A simple matrix decomposition is needed to recover the solution of the original problem from the solution of the restricted one. We show how this approach can be applied to solving some important signal processing problems that contain null-sha** constraints. As a byproduct of our study, the conjugacy of beamfoming and parameter estimation problems leads us to formulation of a new and rigorous criterion for signal/noise subspace identification. Simulation results are performed for the problem of rank-constrained beamforming design and show an exact agreement of the solution with the proposed algebraic structure, as well as significant performance improvements in terms of sidelobe suppression compared to the existing methods. △ Less

Submitted 7 October, 2016; originally announced October 2016.

Comments: 12 two columns pages, 5 figures, Submitted to IEEE Trans. Signal Processing on September 2016

Downlink Performance of Superimposed Pilots in Massive MIMO systems

Authors: Karthik Upadhya, Sergiy A. Vorobyov, Mikko Vehkapera

Abstract: In this paper, we investigate the downlink throughput performance of a massive multiple-input multiple-output (MIMO) system that employs superimposed pilots for channel estimation. The component of downlink (DL) interference that results from transmitting data alongside pilots in the uplink (UL) is shown to decrease at a rate proportional to the square root of the number of antennas at the BS. The… ▽ More In this paper, we investigate the downlink throughput performance of a massive multiple-input multiple-output (MIMO) system that employs superimposed pilots for channel estimation. The component of downlink (DL) interference that results from transmitting data alongside pilots in the uplink (UL) is shown to decrease at a rate proportional to the square root of the number of antennas at the BS. The normalized mean-squared error (NMSE) of the channel estimate is compared with the Bayesian Cramér-Rao lower bound that is derived for the system, and the former is also shown to diminish with increasing number of antennas at the base station (BS). Furthermore, we show that staggered pilots are a particular case of superimposed pilots and offer the downlink throughput of superimposed pilots while retaining the UL spectral and energy efficiency of regular pilots. We also extend the framework for designing a hybrid system, consisting of users that transmit either regular or superimposed pilots, to minimize both the UL and DL interference. The improved NMSE and DL rates of the channel estimator based on superimposed pilots are demonstrated by means of simulations. △ Less

Submitted 20 March, 2018; v1 submitted 14 June, 2016; originally announced June 2016.

Comments: 28 single-column pages, 6 figures, 1 table, Submitted to IEEE Trans. Wireless Commun. in Aug 2017. Revised Submission in Feb. 2018

Journal ref: IEEE Trans. Wireless Communications, vol. 17, no. 10, pp. 6630-6644, Oct. 2018

Superimposed Pilots are Superior for Mitigating Pilot Contamination in Massive MIMO

Authors: Karthik Upadhya, Sergiy A. Vorobyov, Mikko Vehkapera

Abstract: In this paper, superimposed pilots are introduced as an alternative to time-multiplexed pilot and data symbols for mitigating pilot contamination in massive multiple-input multiple-output (MIMO) systems. We propose a non-iterative scheme for uplink channel estimation based on superimposed pilots and derive an expression for the uplink signal-to-interference-plus-noise ratio (SINR) at the output of… ▽ More In this paper, superimposed pilots are introduced as an alternative to time-multiplexed pilot and data symbols for mitigating pilot contamination in massive multiple-input multiple-output (MIMO) systems. We propose a non-iterative scheme for uplink channel estimation based on superimposed pilots and derive an expression for the uplink signal-to-interference-plus-noise ratio (SINR) at the output of a matched filter employing this channel estimate. Based on this expression, we observe that power control is essential when superimposed pilots are employed. Moreover, the quality of the channel estimate can be improved by reducing the interference that results from transmitting data alongside the pilots, and an intuitive iterative data-aided scheme that reduces this component of interference is also proposed. Approximate expressions for the uplink SINR are provided for the iterative data-aided method as well. In addition, we show that a hybrid system with users utilizing both time-multiplexed and superimposed pilots is superior to an optimally designed system that employs only time-multiplexed pilots, even when the non-iterative channel estimate is used to build the detector and precoder. We also describe a simple approach to implement this hybrid system by minimizing the overall inter and intra-cell interference. Numerical simulations demonstrating the performance of the proposed channel estimation schemes and the superiority of the hybrid system are also provided. △ Less

Submitted 2 August, 2017; v1 submitted 2 March, 2016; originally announced March 2016.

Comments: 16 two-column pages, 5 figures, Accepted for publication in IEEE Trans. Signal Processing

Journal ref: IEEE Trans. Signal Processing, vol. 65, no. 11, pp. 2917-2932, June 2017

Joint Robust Transmit/Receive Adaptive Beamforming for MIMO Radar Using Probability-Constrained Optimization

Authors: Weiyu Zhang, Sergiy A. Vorobyov

Abstract: A joint robust transmit/receive adaptive beamforming for multiple-input multipleoutput (MIMO) radar based on probability-constrained optimization approach is developed in the case of Gaussian and arbitrary distributed mismatch present in both the transmit and receive signal steering vectors. A tight lower bound of the probability constraint is also derived by using duality theory. The formulated p… ▽ More A joint robust transmit/receive adaptive beamforming for multiple-input multipleoutput (MIMO) radar based on probability-constrained optimization approach is developed in the case of Gaussian and arbitrary distributed mismatch present in both the transmit and receive signal steering vectors. A tight lower bound of the probability constraint is also derived by using duality theory. The formulated probability-constrained robust beamforming problem is nonconvex and NP-hard. However, we reformulate its cost function into a bi-quadratic function while the probability constraint splits into transmit and receive parts. Then, a block coordinate descent method based on second-order cone programming is developed to address the biconvex problem. Simulation results show an improved robustness of the proposed beamforming method as compared to the worst-case and other existing state-of-the-art joint transmit/receive robust adaptive beamforming methods for MIMO radar. △ Less

Submitted 10 August, 2015; originally announced August 2015.

Comments: 14 pages, 1 figure, Submitted to IEEE Signal Processing Letters on May 2015

Journal ref: IEEE Signal Processing Letters, vol. 23, no. 1, pp. 112-116, Jan. 2016

Ambiguity Function of the Transmit Beamspace-Based MIMO Radar

Authors: Yongzhe Li, Sergiy A. Vorobyov, Visa Koivunen

Abstract: In this paper, we derive an ambiguity function (AF) for the transmit beamspace (TB)-based multipleinput multiple-output (MIMO) radar for the case of far-field targets and narrow-band waveforms. The effects of transmit coherent processing gain and waveform diversity are incorporated into the AF definition. To cover all the phase information conveyed by different factors, we introduce the equivalent… ▽ More In this paper, we derive an ambiguity function (AF) for the transmit beamspace (TB)-based multipleinput multiple-output (MIMO) radar for the case of far-field targets and narrow-band waveforms. The effects of transmit coherent processing gain and waveform diversity are incorporated into the AF definition. To cover all the phase information conveyed by different factors, we introduce the equivalent transmit phase centers. The newly defined AF serves as a generalized AF form for which the phased-array (PA) and traditional MIMO radar AFs are important special cases. We establish relationships among the defined TB-based MIMO radar AF and the existing AF results including the Woodward's AF, the AFs defined for the traditional colocated MIMO radar, and also the PA radar AF, respectively. Moreover, we compare the TB-based MIMO radar AF with the square-summation-form AF definition and identify two limiting cases to bound its 'clear region' in Doppler-delay domain that is free of sidelobes. Corresponding bounds for these two cases are derived, and it is shown that the bound for the worst case is inversely proportional to the number of transmitted waveforms K, whereas the bound for the best case is independent of K. The actual 'clear region' of the TB-based MIMO radar AF depends on the array configuration and is in between of the worst- and best-case bounds. We propose a TB design strategy to reduce the levels of the AF sidelobes, and show in simulations that proper design of the TB matrix leads to reduction of the relative sidelobe levels of the TB-based MIMO radar AF. △ Less

Submitted 23 March, 2015; originally announced March 2015.

Comments: 28 pages, 4 figures, Submitted to IEEE Trans. Signal Processing on July 2014

Journal ref: IEEE Trans. Signal Processing, vol. 63, no. 17, pp.4445-4457, Sept. 2015

Cramer-Rao Bound for Sparse Signals Fitting the Low-Rank Model with Small Number of Parameters

Authors: Mahdi Shaghaghi, Sergiy A. Vorobyov

Abstract: In this paper, we consider signals with a low-rank covariance matrix which reside in a low-dimensional subspace and can be written in terms of a finite (small) number of parameters. Although such signals do not necessarily have a sparse representation in a finite basis, they possess a sparse structure which makes it possible to recover the signal from compressed measurements. We study the statisti… ▽ More In this paper, we consider signals with a low-rank covariance matrix which reside in a low-dimensional subspace and can be written in terms of a finite (small) number of parameters. Although such signals do not necessarily have a sparse representation in a finite basis, they possess a sparse structure which makes it possible to recover the signal from compressed measurements. We study the statistical performance bound for parameter estimation in the low-rank signal model from compressed measurements. Specifically, we derive the Cramer-Rao bound (CRB) for a generic low-rank model and we show that the number of compressed samples needs to be larger than the number of sources for the existence of an unbiased estimator with finite estimation variance. We further consider the applications to direction-of-arrival (DOA) and spectral estimation which fit into the low-rank signal model. We also investigate the effect of compression on the CRB by considering numerical examples of the DOA estimation scenario, and show how the CRB increases by increasing the compression or equivalently reducing the number of compressed samples. △ Less

Submitted 26 February, 2015; originally announced February 2015.

Comments: 14 pages, 1 figure, Submitted to IEEE Signal Processing Letters on December 2014

Journal ref: IEEE Signal Processing Letters, vol. 22, no. 9, pp. 1497-1501, Sept. 2015

Subspace Leakage Analysis and Improved DOA Estimation with Small Sample Size

Authors: Mahdi Shaghaghi, Sergiy A. Vorobyov

Abstract: Classical methods of DOA estimation such as the MUSIC algorithm are based on estimating the signal and noise subspaces from the sample covariance matrix. For a small number of samples, such methods are exposed to performance breakdown, as the sample covariance matrix can largely deviate from the true covariance matrix. In this paper, the problem of DOA estimation performance breakdown is investiga… ▽ More Classical methods of DOA estimation such as the MUSIC algorithm are based on estimating the signal and noise subspaces from the sample covariance matrix. For a small number of samples, such methods are exposed to performance breakdown, as the sample covariance matrix can largely deviate from the true covariance matrix. In this paper, the problem of DOA estimation performance breakdown is investigated. We consider the structure of the sample covariance matrix and the dynamics of the root-MUSIC algorithm. The performance breakdown in the threshold region is associated with the subspace leakage where some portion of the true signal subspace resides in the estimated noise subspace. In this paper, the subspace leakage is theoretically derived. We also propose a two-step method which improves the performance by modifying the sample covariance matrix such that the amount of the subspace leakage is reduced. Furthermore, we introduce a phenomenon named as root-swap which occurs in the root-MUSIC algorithm in the low sample size region and degrades the performance of the DOA estimation. A new method is then proposed to alleviate this problem. Numerical examples and simulation results are given for uncorrelated and correlated sources to illustrate the improvement achieved by the proposed methods. Moreover, the proposed algorithms are combined with the pseudo-noise resampling method to further improve the performance. △ Less

Submitted 31 January, 2015; originally announced February 2015.

Comments: 37 pages, 10 figures, Submitted to the IEEE Transactions on Signal Processing in July 2014

Journal ref: IEEE Trans. Signal Processing, vol. 63, no. 12, pp. 3251-3265, June 2015

Performance Limits of Segmented Compressive Sampling: Correlated Samples versus Bits

Authors: Hao Fang, Sergiy A. Vorobyov, Hai Jiang

Abstract: This paper gives performance limits of the segmented compressive sampling (CS) which collects correlated samples. It is shown that the effect of correlation among samples for the segmented CS can be characterized by a penalty term in the corresponding bounds on the sampling rate. Moreover, this penalty term is vanishing as the signal dimension increases. It means that the performance degradation d… ▽ More This paper gives performance limits of the segmented compressive sampling (CS) which collects correlated samples. It is shown that the effect of correlation among samples for the segmented CS can be characterized by a penalty term in the corresponding bounds on the sampling rate. Moreover, this penalty term is vanishing as the signal dimension increases. It means that the performance degradation due to the fixed correlation among samples obtained by the segmented CS (as compared to the standard CS with equivalent size sampling matrix) is negligible for a high-dimensional signal. In combination with the fact that the signal reconstruction quality improves with additional samples obtained by the segmented CS (as compared to the standard CS with sampling matrix of the size given by the number of original uncorrelated samples), the fact that the additional correlated samples also provide new information about a signal is a strong argument for the segmented CS. △ Less

Submitted 19 November, 2014; originally announced November 2014.

Comments: 27 pages, 8 figures, Submitted to IEEE Trans. Signal Processing on November 2014

Journal ref: IEEE Trans. Signal Processing, vol. 63, no. 22, pp. 6061-6073, Nov. 2015

On the Optimal Precoding for MIMO Gaussian Wire-Tap Channels

Authors: Arash Khabbazibasmenj, Maksym A. Girnyk, Sergiy A. Vorobyov, Mikko Vehkaperä, Lars K. Rasmussen

Abstract: We consider the problem of finding secrecy rate of a multiple-input multiple-output (MIMO) wire-tap channel. A transmitter, a legitimate receiver, and an eavesdropper are all equipped with multiple antennas. The channel states from the transmitter to the legitimate user and to the eavesdropper are assumed to be known at the transmitter. In this contribution, we address the problem of finding the o… ▽ More We consider the problem of finding secrecy rate of a multiple-input multiple-output (MIMO) wire-tap channel. A transmitter, a legitimate receiver, and an eavesdropper are all equipped with multiple antennas. The channel states from the transmitter to the legitimate user and to the eavesdropper are assumed to be known at the transmitter. In this contribution, we address the problem of finding the optimal precoder/transmit covariance matrix maximizing the secrecy rate of the given wiretap channel. The problem formulation is shown to be equivalent to a difference of convex functions programming problem and an efficient algorithm for addressing this problem is developed. △ Less

Submitted 1 November, 2014; originally announced November 2014.

Comments: Published in Proceedings of the Tenth International Symposium on Wireless Communication Systems (ISWCS 2013), Ilmenau, Germany, August 2013

Journal ref: In Proc. 10th Int. Symp. Wireless Commun. Syst. (ISWCS), pp. 1-4, 2013

How Many Beamforming Vectors Generate the Same Beampattern?

Authors: Arash Khabbazibasmenj, Aboulnasr Hassanien, Sergiy A. Vorobyov

Abstract: In this letter, we address the fundamental question of how many beamforming vectors exist which generate the same beampattern? The question is relevant to many fields such as, for example, array processing, radar, wireless communications, data compression, dimensionality reduction, and biomedical engineering. The desired property of having the same beampattern for different columns of a beamspace… ▽ More In this letter, we address the fundamental question of how many beamforming vectors exist which generate the same beampattern? The question is relevant to many fields such as, for example, array processing, radar, wireless communications, data compression, dimensionality reduction, and biomedical engineering. The desired property of having the same beampattern for different columns of a beamspace transformation matrix (beamforming vectors) often plays a key importance in practical applications. The result is that at most 2^{M-1}-1 beamforming vectors with the same beampattern can be generated from any given beamforming vector. Here M is the dimension of the beamforming vector. At the constructive side, the answer to this question allows for computationally efficient techniques for the beamspace transformation design. Indeed, one can start with a single beamforming vector, which gives a desired beampattern, and generate a number of other beamforming vectors, which give absolutely the same beampattern, in a computationally efficient way. We call the initial beamforming vector as the mother beamforming vector. One possible procedure for generating all possible new beamforming vectors with the same beampattern from the mother beamforming vector is proposed. The application of the proposed analysis to the transmit beamspace design in multiple-input multiple-output radar is also given. △ Less

Submitted 7 February, 2014; originally announced February 2014.

Comments: 12 pages, 3 figures, 2 tables, Submitted to the IEEE Signal Processing Letters in February 2014

Journal ref: IEEE Signal Processing Letters, vol. 22, no. 10, pp. 1609-1613, Oct. 2015

Simple Semi-Distributed Lifetime Maximizing Strategy via Power Allocation in Collaborative Beamforming for Wireless Sensor Networks

Authors: Mohammed F. A. Ahmed, Sergiy A. Vorobyov

Abstract: Energy-efficient communication is an important issue in wireless sensor networks (WSNs) consisting of large number of energy-constrained sensor nodes. Indeed, sensor nodes have different energy budgets assigned to data transmission at individual nodes. Therefore, without energy-aware transmission schemes, energy can deplete from sensor nodes with smaller energy budget faster than from the rest of… ▽ More Energy-efficient communication is an important issue in wireless sensor networks (WSNs) consisting of large number of energy-constrained sensor nodes. Indeed, sensor nodes have different energy budgets assigned to data transmission at individual nodes. Therefore, without energy-aware transmission schemes, energy can deplete from sensor nodes with smaller energy budget faster than from the rest of the sensor nodes in WSNs. This reduces the coverage area as well as the lifetime of WSNs. Collaborative beamforming (CB) has been proposed originally to achieve directional gain, however, it also inherently distributes the corresponding energy consumption over the collaborative sensor nodes. In fact, CB can be seen as a physical layer solution (versus the media access control/network layer solution) to balance the lifetimes of individual sensor nodes and extend the lifetime of the whole WSN. However, the introduction of energy-aware CB schemes is critical for extending the WSNs lifetime. In this paper, CB with power allocation (CB-PA) is developed to extend the lifetime of a cluster of collaborative sensor nodes by balancing the individual sensor node lifetimes. A novel strategy is proposed to utilize the residual energy information available at each sensor node. It adjusts the energy consumption rate at each sensor node while achieving the required average signal-to-noise ratio (SNR) at the destination. It is a semi-distributed strategy and it maintains average SNR. Different factors affecting the energy consumption are studied as well. Simulation results show that CB-PA outperforms CB with Equal Power Allocation (CB-EPA) in terms of extending the lifetime of a cluster of collaborative nodes. △ Less

Submitted 16 January, 2014; originally announced January 2014.

Comments: 27 pages, 11 figures, Finished in March 2011, Unpublished

Efficient Strategies for Single/Multi-Target Jamming on MIMO Gaussian Channels

Authors: Jie Gao, Sergiy A. Vorobyov, Hai Jiang

Abstract: The problem of jamming on multiple-input multiple-output (MIMO) Gaussian channels is investigated in this paper. In the case of a single target legitimate signal, we show that the existing result based on the simplification of the system model by neglecting the jamming channel leads to losing important insights regarding the effect of jamming power and jamming channel on the jamming strategy. We f… ▽ More The problem of jamming on multiple-input multiple-output (MIMO) Gaussian channels is investigated in this paper. In the case of a single target legitimate signal, we show that the existing result based on the simplification of the system model by neglecting the jamming channel leads to losing important insights regarding the effect of jamming power and jamming channel on the jamming strategy. We find a closed-form optimal solution for the problem under a positive semi-definite (PSD) condition without considering simplifications in the model. If the condition is not satisfied and the optimal solution may not exist in closed-form, we find the optimal solution using a numerical method and also propose a suboptimal solution in closed-form as a close approximation of the optimal solution. Then, the possibility of extending the results to solve the problem of multi-target jamming is investigated for four scenarios, i.e., multiple access channel, broadcasting channel, multiple transceiver pairs with orthogonal transmissions, and multiple transceiver pairs with interference, respectively. It is shown that the proposed numerical method can be extended to all scenarios while the proposed closed-form solutions for jamming may be applied in the scenarios of the multiple access channel and multiple transceiver pairs with orthogonal transmissions. Simulation results verify the effectiveness of the proposed solutions. △ Less

Submitted 15 January, 2014; originally announced January 2014.

Comments: 24 pages, 5 figures, Submitted to IEEE Trans. Signal Processing on December 2013

Journal ref: IEEE Trans. Signal Processing, vol. 63, no. 21, pp. 5821-5836, Nov. 2015

Reweighted l1-norm Penalized LMS for Sparse Channel Estimation and Its Analysis

Authors: Omid Taheri, Sergiy A. Vorobyov

Abstract: A new reweighted l1-norm penalized least mean square (LMS) algorithm for sparse channel estimation is proposed and studied in this paper. Since standard LMS algorithm does not take into account the sparsity information about the channel impulse response (CIR), sparsity-aware modifications of the LMS algorithm aim at outperforming the standard LMS by introducing a penalty term to the standard LMS c… ▽ More A new reweighted l1-norm penalized least mean square (LMS) algorithm for sparse channel estimation is proposed and studied in this paper. Since standard LMS algorithm does not take into account the sparsity information about the channel impulse response (CIR), sparsity-aware modifications of the LMS algorithm aim at outperforming the standard LMS by introducing a penalty term to the standard LMS cost function which forces the solution to be sparse. Our reweighted l1-norm penalized LMS algorithm introduces in addition a reweighting of the CIR coefficient estimates to promote a sparse solution even more and approximate l0-pseudo-norm closer. We provide in depth quantitative analysis of the reweighted l1-norm penalized LMS algorithm. An expression for the excess mean square error (MSE) of the algorithm is also derived which suggests that under the right conditions, the reweighted l1-norm penalized LMS algorithm outperforms the standard LMS, which is expected. However, our quantitative analysis also answers the question of what is the maximum sparsity level in the channel for which the reweighted l1-norm penalized LMS algorithm is better than the standard LMS. Simulation results showing the better performance of the reweighted l1-norm penalized LMS algorithm compared to other existing LMS-type algorithms are given. △ Less

Submitted 15 January, 2014; originally announced January 2014.

Comments: 28 pages, 4 figures, 1 table, Submitted to Signal Processing on June 2013

Journal ref: O. Taheri and S.A. Vorobyov, "Reweighted l1-norm penalized LMS for sparse channel estimation and its analysis," Signal Processing, vol. 104, pp. 70-79, Nov. 2014

Equivalent Codes, Optimality, and Performance Analysis of OSTBC: Textbook Study

Authors: Alex E. Geyer, Reza Nikjah, Sergiy A. Vorobyov, Norman C. Beaulieu

Abstract: An equivalent model for a multi-input multi-output (MIMO) communication system with orthogonal space-time block codes (OSTBCs) is proposed based on a newly revealed connection between OSTBCs and Euclidean codes. Examples of distance spectra, signal constellations, and signal coordinate diagrams of Euclidean codes equivalent to simplest OSTBCs are given. A new asymptotic upper bound for the symbol… ▽ More An equivalent model for a multi-input multi-output (MIMO) communication system with orthogonal space-time block codes (OSTBCs) is proposed based on a newly revealed connection between OSTBCs and Euclidean codes. Examples of distance spectra, signal constellations, and signal coordinate diagrams of Euclidean codes equivalent to simplest OSTBCs are given. A new asymptotic upper bound for the symbol error rate (SER) of OSTBCs, based on the distance spectra of the introduced equivalent Euclidean codes is derived, and new general design criteria for signal constellations of the optimal OSTBC are proposed. Some bounds relating distance properties, dimensionality, and cardinality of OSTBCs with constituent signals of equal energy are given, and new optimal signal constellations with cardinalities M = 8 and M = 16 for Alamouti's code are designed. Using the new model for MIMO communication systems with OSTBCs, a general methodology for performance analysis of OSTBCs is developed. As an example of the application of this methodology, an exact evaluation of the SER of any OSTBC is given. Namely, a new expression for the SER of Alamouti's OSTBC with binary phase shift keying (BPSK) signals is derived. △ Less

Submitted 15 January, 2014; originally announced January 2014.

Comments: 33 pages, 12 figures, 5 tables, full size journal paper, Finished in Oct. 2009, Unpublished

Journal ref: IEEE Trans. Communications, vol. 63, no. 8, pp. 2912-2923, Aug. 2015

Permutation Enhanced Parallel Reconstruction with A Linear Compressive Sampling Device

Authors: Hao Fang, Sergiy A. Vorobyov, Hai Jiang

Abstract: In this letter, a permutation enhanced parallel reconstruction architecture for compressive sampling is proposed. In this architecture, a measurement matrix is constructed from a block-diagonal sensing matrix and the sparsifying basis of the target signal. In this way, the projection of the signal onto the sparsifying basis can be divided into several segments and all segments can be reconstructed… ▽ More In this letter, a permutation enhanced parallel reconstruction architecture for compressive sampling is proposed. In this architecture, a measurement matrix is constructed from a block-diagonal sensing matrix and the sparsifying basis of the target signal. In this way, the projection of the signal onto the sparsifying basis can be divided into several segments and all segments can be reconstructed in parallel. Thus, the computational complexity and the time for reconstruction can be reduced significantly. This feature is especially appealing for big data processing. Furthermore, to reduce the number of measurements needed to achieve the desired reconstruction error performance, permutation is introduced for the projection of the signal. It is shown that the permutation can be performed implicitly by using a pre-designed measurement matrix. Thus, the permutation enhanced parallel reconstruction can be achieved with a linear compressive sampling device. △ Less

Submitted 28 August, 2014; v1 submitted 17 August, 2013; originally announced August 2013.

Comments: 11 pages, 4 figures, 1 table

Finite-Length and Asymptotic Analysis of Correlogram for Undersampled Data

Authors: Mahdi Shaghaghi, Sergiy A. Vorobyov

Abstract: This paper studies a spectrum estimation method for the case that the samples are obtained at a rate lower than the Nyquist rate. The method is referred to as the correlogram for undersampled data. The algorithm partitions the spectrum into a number of segments and estimates the average power within each spectral segment. This method is able to estimate the power spectrum density of a signal from… ▽ More This paper studies a spectrum estimation method for the case that the samples are obtained at a rate lower than the Nyquist rate. The method is referred to as the correlogram for undersampled data. The algorithm partitions the spectrum into a number of segments and estimates the average power within each spectral segment. This method is able to estimate the power spectrum density of a signal from undersampled data without essentially requiring the signal to be sparse. We derive the bias and the variance of the spectrum estimator, and show that there is a tradeoff between the accuracy of the estimation, the frequency resolution, and the complexity of the estimator. A closed-form approximation of the estimation variance is also derived, which clearly shows how the variance is related to different parameters. The asymptotic behavior of the estimator is also investigated, and it is proved that this spectrum estimator is consistent. Moreover, the estimation made for different spectral segments becomes uncorrelated as the signal length tends to infinity. Finally, numerical examples and simulation results are provided, which approve the theoretical conclusions. △ Less

Submitted 23 May, 2013; originally announced May 2013.

Comments: 28 pages, 6 figures, submitted to the IEEE Trans. Signal Processing in May 2012 and current version in May 2013. arXiv admin note: text overlap with arXiv:1202.2408

Journal ref: Applied and Computational Harmonic Analysis, vol. 43, no. 3, pp. 404-423, Nov. 2017

Permutation Meets Parallel Compressed Sensing: How to Relax Restricted Isometry Property for 2D Sparse Signals

Authors: Hao Fang, Sergiy A. Vorobyov, Hai Jiang, Omid Taheri

Abstract: Traditional compressed sensing considers sampling a 1D signal. For a multidimensional signal, if reshaped into a vector, the required size of the sensing matrix becomes dramatically large, which increases the storage and computational complexity significantly. To solve this problem, we propose to reshape the multidimensional signal into a 2D signal and sample the 2D signal using compressed sensing… ▽ More Traditional compressed sensing considers sampling a 1D signal. For a multidimensional signal, if reshaped into a vector, the required size of the sensing matrix becomes dramatically large, which increases the storage and computational complexity significantly. To solve this problem, we propose to reshape the multidimensional signal into a 2D signal and sample the 2D signal using compressed sensing column by column with the same sensing matrix. It is referred to as parallel compressed sensing, and it has much lower storage and computational complexity. For a given reconstruction performance of parallel compressed sensing, if a so-called acceptable permutation is applied to the 2D signal, we show that the corresponding sensing matrix has a smaller required order of restricted isometry property condition, and thus, storage and computation requirements are further lowered. A zigzag-scan-based permutation, which is shown to be particularly useful for signals satisfying a layer model, is introduced and investigated. As an application of the parallel compressed sensing with the zigzag-scan-based permutation, a video compression scheme is presented. It is shown that the zigzag-scan-based permutation increases the peak signal-to-noise ratio of reconstructed images and video frames. △ Less

Submitted 21 May, 2013; originally announced May 2013.

Comments: 30 pages, 10 figures, 3 tables, submitted to the IEEE Trans. Signal Processing in November 2012

Journal ref: H. Fang, S.A. Vorobyov, H. Jiang, O. Taheri, "Permutation meets parallel compressed sensing. How to relax RIP for 2D srarse signals," IEEE Trans. Signal Processing, vol. 62, no. 1, pp. 196-210, Jan. 2014

Efficient Transmit Beamspace Design for Search-free Based DOA Estimation in MIMO Radar

Authors: Arash Khabbazibasmenj, Aboulnasr Hassanien, Sergiy A. Vorobyov, Matthew W. Morency

Abstract: In this paper, we address the problem of transmit beamspace design for multiple-input multiple-output (MIMO) radar with colocated antennas in application to direction-of-arrival (DOA) estimation. A new method for designing the transmit beamspace matrix that enables the use of search-free DOA estimation techniques at the receiver is introduced. The essence of the proposed method is to design the tr… ▽ More In this paper, we address the problem of transmit beamspace design for multiple-input multiple-output (MIMO) radar with colocated antennas in application to direction-of-arrival (DOA) estimation. A new method for designing the transmit beamspace matrix that enables the use of search-free DOA estimation techniques at the receiver is introduced. The essence of the proposed method is to design the transmit beamspace matrix based on minimizing the difference between a desired transmit beampattern and the actual one under the constraint of uniform power distribution across the transmit array elements. The desired transmit beampattern can be of arbitrary shape and is allowed to consist of one or more spatial sectors. The number of transmit waveforms is even but otherwise arbitrary. To allow for simple search-free DOA estimation algorithms at the receive array, the rotational invariance property is established at the transmit array by imposing a specific structure on the beamspace matrix. Semi-definite relaxation is used to transform the proposed formulation into a convex problem that can be solved efficiently. We also propose a spatial-division based design (SDD) by dividing the spatial domain into several subsectors and assigning a subset of the transmit beams to each subsector. The transmit beams associated with each subsector are designed separately. Simulation results demonstrate the improvement in the DOA estimation performance offered by using the proposed joint and SDD transmit beamspace design methods as compared to the traditional MIMO radar technique. △ Less

Submitted 21 May, 2013; originally announced May 2013.

Comments: 32 pages, 10 figures, submitted to the IEEE Trans. Signal Processing in May 2013

Journal ref: A. Khabbazibasmenj, A. Hassanien, S.A. Vorobyov, M.W. Morency, "Efficient transmit beamspace design for search-free based DOA estimation in MIMO radar," IEEE Trans. Signal Processing, vol. 62, no. 6, pp. 1490-1500, Mar. 2014

Sum-Rate Maximization with Minimum Power Consumption for MIMO DF Two-Way Relaying: Part I - Relay Optimization

Authors: Jie Gao, Sergiy A. Vorobyov, Hai Jiang, Jianshu Zhang, Martin Haardt

Abstract: The problem of power allocation is studied for a multiple-input multiple-output (MIMO) decode-and-forward (DF) two-way relaying system consisting of two source nodes and one relay. It is shown that achieving maximum sum-rate in such a system does not necessarily demand the consumption of all available power at the relay. Instead, the maximum sum-rate can be achieved through efficient power allocat… ▽ More The problem of power allocation is studied for a multiple-input multiple-output (MIMO) decode-and-forward (DF) two-way relaying system consisting of two source nodes and one relay. It is shown that achieving maximum sum-rate in such a system does not necessarily demand the consumption of all available power at the relay. Instead, the maximum sum-rate can be achieved through efficient power allocation with minimum power consumption. Deriving such power allocation, however, is nontrivial due to the fact that it generally leads to a nonconvex problem. In Part I of this two-part paper, a sum-rate maximizing power allocation with minimum power consumption is found for MIMO DF two-way relaying, in which the relay optimizes its own power allocation strategy given the power allocation strategies of the source nodes. An algorithm is proposed for efficiently finding the optimal power allocation of the relay based on the proposed idea of relative water-levels. The considered scenario features low complexity due to the fact that the relay optimizes its power allocation without coordinating the source nodes. As a trade-off for the low complexity, it is shown that there can be waste of power at the source nodes because of no coordination between the relay and the source nodes. Simulation results demonstrate the performance of the proposed algorithm and the effect of asymmetry on the considered system. △ Less

Submitted 8 January, 2013; originally announced January 2013.

Comments: 24 pages, 4 figures, Submitted to the IEEE Trans. Signal Processing in August 2012

Journal ref: J. Gao, S.A. Vorobyov, H. Jiang, J. Zhang, M. Haardt, "Sum-rate maximization with minimum power consumption for MIMO DF TWR. Part I Relay optimization," IEEE Trans. Signal Processing, vol. 61, no. 14, pp. 3563-3577, July 2013

Sum-Rate Maximization with Minimum Power Consumption for MIMO DF Two-Way Relaying: Part II - Network Optimization

Authors: Jie Gao, Sergiy A. Vorobyov, Hai Jiang, Jianshu Zhang, Martin Haardt

Abstract: In Part II of this two-part paper, a sum-rate-maximizing power allocation with minimum power consumption is found for multiple-input multiple-output (MIMO) decode-and-forward (DF) two-way relaying (TWR) in a network optimization scenario. In this scenario, the relay and the source nodes jointly optimize their power allocation strategies to achieve network optimality. Unlike the relay optimization… ▽ More In Part II of this two-part paper, a sum-rate-maximizing power allocation with minimum power consumption is found for multiple-input multiple-output (MIMO) decode-and-forward (DF) two-way relaying (TWR) in a network optimization scenario. In this scenario, the relay and the source nodes jointly optimize their power allocation strategies to achieve network optimality. Unlike the relay optimization scenario considered in part I which features low complexity but does not achieve network optimality, the network-level optimal power allocation can be achieved in the network optimization scenario at the cost of higher complexity. The network optimization problem is considered in two cases each with several subcases. It is shown that the considered problem, which is originally nonconvex, can be transferred into different convex problems for all but two subcases. For the remaining two subcases, one for each case, it is proved that the optimal strategies for the source nodes and the relay must satisfy certain properties. Based on these properties, an algorithm is proposed for finding the optimal solution. The effect of asymmetry in the number of antennas, power limits, and channel statistics is also considered. Such asymmetry is shown to have a negative effect on both the achievable sum-rate and the power allocation efficiency in MIMO DF TWR. Simulation results demonstrate the performance of the proposed algorithm and the effect of asymmetry in the system. △ Less

Submitted 14 December, 2012; originally announced December 2012.

Comments: 24 pages, 5 figures, submitted to the IEEE Trans. Signal Processing in Aug. 2012

Journal ref: J. Gao, S.A. Vorobyov, H. Jiang, J. Zhang, M. Haardt, "Sum rate maximization with minimum power consumption for MIMO DF TWR. Part II Network optimization," IEEE Trans. Signal Processing, vol. 61, no. 14, pp. 3578-3591, July 2013

Robust Adaptive Beamforming for General-Rank Signal Model with Positive Semi-Definite Constraint via POTDC

Authors: Arash Khabbazibasmenj, Sergiy A. Vorobyov

Abstract: The robust adaptive beamforming (RAB) problem for general-rank signal model with an additional positive semi-definite constraint is considered. Using the principle of the worst-case performance optimization, such RAB problem leads to a difference-of-convex functions (DC) optimization problem. The existing approaches for solving the resulted non-convex DC problem are based on approximations and fin… ▽ More The robust adaptive beamforming (RAB) problem for general-rank signal model with an additional positive semi-definite constraint is considered. Using the principle of the worst-case performance optimization, such RAB problem leads to a difference-of-convex functions (DC) optimization problem. The existing approaches for solving the resulted non-convex DC problem are based on approximations and find only suboptimal solutions. Here we solve the non-convex DC problem rigorously and give arguments suggesting that the solution is globally optimal. Particularly, we rewrite the problem as the minimization of a one-dimensional optimal value function whose corresponding optimization problem is non-convex. Then, the optimal value function is replaced with another equivalent one, for which the corresponding optimization problem is convex. The new one-dimensional optimal value function is minimized iteratively via polynomial time DC (POTDC) algorithm.We show that our solution satisfies the Karush-Kuhn-Tucker (KKT) optimality conditions and there is a strong evidence that such solution is also globally optimal. Towards this conclusion, we conjecture that the new optimal value function is a convex function. The new RAB method shows superior performance compared to the other state-of-the-art general-rank RAB methods. △ Less

Submitted 14 December, 2012; originally announced December 2012.

Comments: 29 pages, 7 figures, 2 tables, Submitted to IEEE Trans. Signal Processing on August 2012

Journal ref: A. Khabbazibasmenj and S.A. Vorobyov, "Robust adaptive beamforming for general-rank signal model with positive semi-definite constraint via POTDC," IEEE Trans. Signal Processing, vol. 61, no. 23, pp. 6103-6117, Dec. 2013

Sum-Rate Maximization in Two-Way AF MIMO Relaying: Polynomial Time Solutions to a Class of DC Programming Problems

Authors: Arash Khabbazibasmenj, Florian Roemer, Sergiy A. Vorobyov, Martin Haardt

Abstract: Sum-rate maximization in two-way amplify-and-forward (AF) multiple-input multiple-output (MIMO) relaying belongs to the class of difference-of-convex functions (DC) programming problems. DC programming problems occur as well in other signal processing applications and are typically solved using different modifications of the branch-and-bound method. This method, however, does not have any polynomi… ▽ More Sum-rate maximization in two-way amplify-and-forward (AF) multiple-input multiple-output (MIMO) relaying belongs to the class of difference-of-convex functions (DC) programming problems. DC programming problems occur as well in other signal processing applications and are typically solved using different modifications of the branch-and-bound method. This method, however, does not have any polynomial time complexity guarantees. In this paper, we show that a class of DC programming problems, to which the sum-rate maximization in two-way MIMO relaying belongs, can be solved very efficiently in polynomial time, and develop two algorithms. The objective function of the problem is represented as a product of quadratic ratios and parameterized so that its convex part (versus the concave part) contains only one (or two) optimization variables. One of the algorithms is called POlynomial-Time DC (POTDC) and is based on semi-definite programming (SDP) relaxation, linearization, and an iterative search over a single parameter. The other algorithm is called RAte-maximization via Generalized EigenvectorS (RAGES) and is based on the generalized eigenvectors method and an iterative search over two (or one, in its approximate version) optimization variables. We also derive an upper-bound for the optimal values of the corresponding optimization problem and show by simulations that this upper-bound can be achieved by both algorithms. The proposed methods for maximizing the sum-rate in the two-way AF MIMO relaying system are shown to be superior to other state-of-the-art algorithms. △ Less

Submitted 10 February, 2012; originally announced February 2012.

Comments: 35 pages, 10 figures, Submitted to the IEEE Trans. Signal Processing in Nov. 2011

Journal ref: A. Khabbazibasmenj, F. Roemer, S.A. Vorobyov, and M. Haardt, "Sum-rate maximization in two-way AF MIMO relaying:," IEEE Trans. Signal Processing, vol. 60, no. 10, pp. 5478-5493, 2012

Spectral Estimation from Undersampled Data: Correlogram and Model-Based Least Squares

Authors: Mahdi Shaghaghi, Sergiy A. Vorobyov

Abstract: This paper studies two spectrum estimation methods for the case that the samples are obtained at a rate lower than the Nyquist rate. The first method is the correlogram method for undersampled data. The algorithm partitions the spectrum into a number of segments and estimates the average power within each spectral segment. We derive the bias and the variance of the spectrum estimator, and show tha… ▽ More This paper studies two spectrum estimation methods for the case that the samples are obtained at a rate lower than the Nyquist rate. The first method is the correlogram method for undersampled data. The algorithm partitions the spectrum into a number of segments and estimates the average power within each spectral segment. We derive the bias and the variance of the spectrum estimator, and show that there is a tradeoff between the accuracy of the estimation and the frequency resolution. The asymptotic behavior of the estimator is also investigated, and it is proved that this spectrum estimator is consistent. A new algorithm for reconstructing signals with sparse spectrum from noisy compressive measurements is also introduced. Such model-based algorithm takes the signal structure into account for estimating the unknown parameters which are the frequencies and the amplitudes of linearly combined sinusoidal signals. A high-resolution spectral estimation method is used to recover the frequencies of the signal elements, while the amplitudes of the signal components are estimated by minimizing the squared norm of the compressed estimation error using the least squares technique. The Cramer-Rao bound for the given system model is also derived. It is shown that the proposed algorithm approaches the bound at high signal to noise ratios. △ Less

Submitted 22 November, 2013; v1 submitted 10 February, 2012; originally announced February 2012.

Comments: This paper has been withdrawn by the author because a more detailed paper on one of the developments reported here has been submitted 'Finite-Length and Asymptotic Analysis of Correlogram for Undersampled Data', arXiv:1305.5592

Moving Target Parameters Estimation in Non-Coherent MIMO Radar Systems

Authors: Aboulnasr Hassanien, Sergiy A. Vorobyov, Alex B. Gershman

Abstract: The problem of estimating the parameters of a moving target in multiple-input multiple-output (MIMO) radar is considered and a new approach for estimating the moving target parameters by making use of the phase information associated with each transmit-receive path is introduced. It is required for this technique that different receive antennas have the same time reference, but no synchronization… ▽ More The problem of estimating the parameters of a moving target in multiple-input multiple-output (MIMO) radar is considered and a new approach for estimating the moving target parameters by making use of the phase information associated with each transmit-receive path is introduced. It is required for this technique that different receive antennas have the same time reference, but no synchronization of initial phases of the receive antennas is needed and, therefore, the estimation process is non-coherent. We model the target motion within a certain processing interval as a polynomial of general order. The first three coefficients of such a polynomial correspond to the initial location, velocity, and acceleration of the target, respectively. A new maximum likelihood (ML) technique for estimating the target motion coefficients is developed. It is shown that the considered ML problem can be interpreted as the classic "overdetermined" nonlinear least-squares problem. The proposed ML estimator requires multi-dimensional search over the unknown polynomial coefficients. The Cramér-Rao Bound (CRB) for the proposed parameter estimation problem is derived. The performance of the proposed estimator is validated by simulation results and is shown to achieve the CRB. △ Less

Submitted 31 January, 2012; originally announced February 2012.

Comments: 17 pages, 4 figures, Submitted to the IEEE Trans. Signal Processing in Aug. 2011

Journal ref: A. Hassanien, S.A. Vorobyov, and A.B. Gershman, "Moving target parameters estimation in non-coherent MIMO radar systems," IEEE Trans. Signal Processing, vol. 60, no. 5, pp. 2354-2361, May 2012

Interference Mitigation for Cognitive Radio MIMO Systems Based on Practical Precoding

Authors: Zengmao Chen, Cheng-Xiang Wang, Xuemin Hong, John Thompson, Sergiy A. Vorobyov, Feng Zhao, Hailin Xiao, Xiaohu Ge

Abstract: In this paper, we propose two subspace-projection-based precoding schemes, namely, full-projection (FP)- and partial-projection (PP)-based precoding, for a cognitive radio multiple-input multiple-output (CR-MIMO) network to mitigate its interference to a primary time-division-duplexing (TDD) system. The proposed precoding schemes are capable of estimating interference channels between CR and prima… ▽ More In this paper, we propose two subspace-projection-based precoding schemes, namely, full-projection (FP)- and partial-projection (PP)-based precoding, for a cognitive radio multiple-input multiple-output (CR-MIMO) network to mitigate its interference to a primary time-division-duplexing (TDD) system. The proposed precoding schemes are capable of estimating interference channels between CR and primary networks, and incorporating the interference from the primary to the CR system into CR precoding via a novel sensing approach. Then, the CR performance and resulting interference of the proposed precoding schemes are analyzed and evaluated. By fully projecting the CR transmission onto a null space of the interference channels, the FP-based precoding scheme can effectively avoid interfering the primary system with boosted CR throughput. While, the PP-based scheme is able to further improve the CR throughput by partially projecting its transmission onto the null space. △ Less

Submitted 20 April, 2011; originally announced April 2011.

Comments: 12 pages, 4 figures, submitted to the IEEE Trans. Wireless Communications in April 2011

Journal ref: Z. Chen, C.-X. Wang, X. Hong, J. Thompson, S.A. Vorobyov, and et al, "Interference mitigation for cognitive radio MIMO systems based on practical precoding," Invited Paper, Physical Communication, vol. 9, pp. 308-315, Dec. 2013

Power Allocation Based on SEP Minimization in Two-Hop Decode-and-Forward Relay Networks

Authors: Arash Khabbazibasmenj, Sergiy A. Vorobyov

Abstract: The problem of optimal power allocation among the relays in a two-hop decode-and-forward cooperative relay network with independent Rayleigh fading channels is considered. It is assumed that only the relays that decode the source message correctly contribute in data transmission. Moreover, only the knowledge of statistical channel state information is available. A new simple closed-form expression… ▽ More The problem of optimal power allocation among the relays in a two-hop decode-and-forward cooperative relay network with independent Rayleigh fading channels is considered. It is assumed that only the relays that decode the source message correctly contribute in data transmission. Moreover, only the knowledge of statistical channel state information is available. A new simple closed-form expression for the average symbol error probability is derived. Based on this expression, a new power allocation method that minimizes the average symbol error probability and takes into account the constraints on the total average power of all the relay nodes and maximum instant power of each relay node is developed. The corresponding optimization problem is shown to be a convex problem that can be solved using interior point methods. However, an approximate closed-form solution is obtained and shown to be practically more appealing due to significant complexity reduction. The accuracy of the approximation is discussed. Moreover, the so obtained closed-form solution gives additional insights into the optimal power allocation problem. Simulation results confirm the improved performance of the proposed power allocation scheme as compared to other schemes. △ Less

Submitted 20 April, 2011; originally announced April 2011.

Comments: 27 pages, 5 figures, submitted to the IEEE Trans. Signal Processing in Feb. 2011

Journal ref: A. Khabbazibasmenj and S.A. Vorobyov, "Power allocation based on SEP minimization in two-hop decode-and-forward relay networks," IEEE Trans. Signal Processing, vol. 59, no. 8, pp. 3954-3963, Aug. 2011

Robust Adaptive Beamforming Based on Steering Vector Estimation via Semidefinite Programming Relaxation

Authors: Arash Khabbazibasmenj, Sergiy A. Vorobyov, Aboulnasr Hassanien

Abstract: We develop a new approach to robust adaptive beamforming in the presence of signal steering vector errors. Since the signal steering vector is known imprecisely, its presumed (prior) value is used to find a more accurate estimate of the actual steering vector, which then is used for obtaining the optimal beamforming weight vector. The objective for finding such an estimate of the actual signal ste… ▽ More We develop a new approach to robust adaptive beamforming in the presence of signal steering vector errors. Since the signal steering vector is known imprecisely, its presumed (prior) value is used to find a more accurate estimate of the actual steering vector, which then is used for obtaining the optimal beamforming weight vector. The objective for finding such an estimate of the actual signal steering vector is the maximization of the beamformer output power, while the constraints are the normalization condition and the requirement that the estimate of the steering vector does not converge to an interference steering vector. Our objective and constraints are free of any design parameters of non-unique choice. The resulting optimization problem is a non-convex quadratically constrained quadratic program, which is NP hard in general. However, for our problem we show that an efficient solution can be found using the semi-definite relaxation technique. Moreover, the strong duality holds for the proposed problem and can also be used for finding the optimal solution efficiently and at low complexity. In some special cases, the solution can be even found in closed-form. Our simulation results demonstrate the superiority of the proposed method over other previously developed robust adaptive beamforming methods for several frequently encountered types of signal steering vector errors. △ Less

Submitted 5 August, 2010; originally announced August 2010.

Comments: 30 pages, 7 figures, Submitted to the IEEE Trans. Signal Processing in July 2010

Journal ref: A. Khabbazibasmenj, S.A. Vorobyov, and A. Hassanien, "Robust adaptive beamforming based on steering vector estimation with as little as possible prior information," IEEE Trans. Signal Processing, vol. 60, no. 6, pp. 2974-2987, June 2012

Aggregate Interference Modeling in Cognitive Radio Networks with Power and Contention Control

Authors: Zengmao Chen, Cheng-Xiang Wang, Xuemin Hong, John Thompson, Sergiy A. Vorobyov, Xiaohu Ge, Hailin Xiao, Feng Zhao

Abstract: In this paper, we present an interference model for cognitive radio (CR) networks employing power control, contention control or hybrid power/contention control schemes. For the first case, a power control scheme is proposed to govern the transmission power of a CR node. For the second one, a contention control scheme at the media access control (MAC) layer, based on carrier sense multiple access… ▽ More In this paper, we present an interference model for cognitive radio (CR) networks employing power control, contention control or hybrid power/contention control schemes. For the first case, a power control scheme is proposed to govern the transmission power of a CR node. For the second one, a contention control scheme at the media access control (MAC) layer, based on carrier sense multiple access with collision avoidance (CSMA/CA), is proposed to coordinate the operation of CR nodes with transmission requests. The probability density functions of the interference received at a primary receiver from a CR network are first derived numerically for these two cases. For the hybrid case, where power and contention controls are jointly adopted by a CR node to govern its transmission, the interference is analyzed and compared with that of the first two schemes by simulations. Then, the interference distributions under the first two control schemes are fitted by log-normal distributions with greatly reduced complexity. Moreover, the effect of a hidden primary receiver on the interference experienced at the receiver is investigated. It is demonstrated that both power and contention controls are effective approaches to alleviate the interference caused by CR networks. Some in-depth analysis of the impact of key parameters on the interference of CR networks is given via numerical studies as well. △ Less

Submitted 5 August, 2010; originally announced August 2010.

Comments: 24 pages, 8 figures, submitted to IEEE Trans. Communications in July 2010

Journal ref: Z. Chen, C.-X. Wang, S.A. Vorobyov, and et al, "Aggregate interference modeling in cognitive radio networks with power and contention control," IEEE Trans. Communications, vol. 60, no. 2, pp. 456-468, Feb. 2012