Showing 1–50 of 75 results for author: Vorobyov, S A

AdaBoost-Based Efficient Channel Estimation and Data Detection in One-Bit Massive MIMO

Authors: Majdoddin Esfandiari, Sergiy A. Vorobyov, Robert W. Heath Jr

Abstract: The use of one-bit analog-to-digital converter (ADC) has been considered as a viable alternative to high resolution counterparts in realizing and commercializing massive multiple-input multiple-output (MIMO) systems. However, the issue of discarding the amplitude information by one-bit quantizers has to be compensated. Thus, carefully tailored methods need to be developed for one-bit channel estim… ▽ More The use of one-bit analog-to-digital converter (ADC) has been considered as a viable alternative to high resolution counterparts in realizing and commercializing massive multiple-input multiple-output (MIMO) systems. However, the issue of discarding the amplitude information by one-bit quantizers has to be compensated. Thus, carefully tailored methods need to be developed for one-bit channel estimation and data detection as the conventional ones cannot be used. To address these issues, the problems of one-bit channel estimation and data detection for MIMO orthogonal frequency division multiplexing (OFDM) system that operates over uncorrelated frequency selective channels are investigated here. We first develop channel estimators that exploit Gaussian discriminant analysis (GDA) classifier and approximated versions of it as the so-called weak classifiers in an adaptive boosting (AdaBoost) approach. Particularly, the combination of the approximated GDA classifiers with AdaBoost offers the benefit of scalability with the linear order of computations, which is critical in massive MIMO-OFDM systems. We then take advantage of the same idea for proposing the data detectors. Numerical results validate the efficiency of the proposed channel estimators and data detectors compared to other methods. They show comparable/better performance to that of the state-of-the-art methods, but require dramatically lower computational complexities and run times. △ Less

Submitted 1 March, 2024; originally announced March 2024.

An Efficient Approximate Method for Online Convolutional Dictionary Learning

Authors: Farshad G. Veshki, Sergiy A. Vorobyov

Abstract: Most existing convolutional dictionary learning (CDL) algorithms are based on batch learning, where the dictionary filters and the convolutional sparse representations are optimized in an alternating manner using a training dataset. When large training datasets are used, batch CDL algorithms become prohibitively memory-intensive. An online-learning technique is used to reduce the memory requiremen… ▽ More Most existing convolutional dictionary learning (CDL) algorithms are based on batch learning, where the dictionary filters and the convolutional sparse representations are optimized in an alternating manner using a training dataset. When large training datasets are used, batch CDL algorithms become prohibitively memory-intensive. An online-learning technique is used to reduce the memory requirements of CDL by optimizing the dictionary incrementally after finding the sparse representations of each training sample. Nevertheless, learning large dictionaries using the existing online CDL (OCDL) algorithms remains highly computationally expensive. In this paper, we present a novel approximate OCDL method that incorporates sparse decomposition of the training samples. The resulting optimization problems are addressed using the alternating direction method of multipliers. Extensive experimental evaluations using several image datasets show that the proposed method substantially reduces computational costs while preserving the effectiveness of the state-of-the-art OCDL algorithms. △ Less

Submitted 25 January, 2023; originally announced January 2023.

Twenty-Five Years of Advances in Beamforming: From Convex and Nonconvex Optimization to Learning Techniques

Authors: Ahmet M. Elbir, Kumar Vijay Mishra, Sergiy A. Vorobyov, Robert W. Heath Jr

Abstract: Beamforming is a signal processing technique to steer, shape, and focus an electromagnetic wave using an array of sensors toward a desired direction. It has been used in several engineering applications such as radar, sonar, acoustics, astronomy, seismology, medical imaging, and communications. With the advances in multi-antenna technologies largely for radar and communications, there has been a g… ▽ More Beamforming is a signal processing technique to steer, shape, and focus an electromagnetic wave using an array of sensors toward a desired direction. It has been used in several engineering applications such as radar, sonar, acoustics, astronomy, seismology, medical imaging, and communications. With the advances in multi-antenna technologies largely for radar and communications, there has been a great interest on beamformer design mostly relying on convex/nonconvex optimization. Recently, machine learning is being leveraged for obtaining attractive solutions to more complex beamforming problems. This article captures the evolution of beamforming in the last twenty-five years from convex-to-nonconvex optimization and optimization-to-learning approaches. It provides a glimpse of this important signal processing technique into a variety of transmit-receive architectures, propagation zones, paths, and conventional/emerging applications. △ Less

Submitted 22 March, 2023; v1 submitted 3 November, 2022; originally announced November 2022.

Comments: Accepted Paper in IEEE Signal Processing Magazine Special Issue on the 75th Anniversary of IEEE Signal Processing Society

Journal ref: IEEE Signal Processing Magazine 2023 Volume 40 , Issue 4

Robust Adaptive Beamforming via Worst-Case SINR Maximization with Nonconvex Uncertainty Sets

Authors: Yongwei Huang, Hao Fu, Sergiy A. Vorobyov, Zhi-Quan Luo

Abstract: This paper considers a formulation of the robust adaptive beamforming (RAB) problem based on worst-case signal-to-interference-plus-noise ratio (SINR) maximization with a nonconvex uncertainty set for the steering vectors. The uncertainty set consists of a similarity constraint and a (nonconvex) double-sided ball constraint. The worst-case SINR maximization problem is turned into a quadratic matri… ▽ More This paper considers a formulation of the robust adaptive beamforming (RAB) problem based on worst-case signal-to-interference-plus-noise ratio (SINR) maximization with a nonconvex uncertainty set for the steering vectors. The uncertainty set consists of a similarity constraint and a (nonconvex) double-sided ball constraint. The worst-case SINR maximization problem is turned into a quadratic matrix inequality (QMI) problem using the strong duality of semidefinite programming. Then a linear matrix inequality (LMI) relaxation for the QMI problem is proposed, with an additional valid linear constraint. Necessary and sufficient conditions for the tightened LMI relaxation problem to have a rank-one solution are established. When the tightened LMI relaxation problem still has a high-rank solution, the LMI relaxation problem is further restricted to become a bilinear matrix inequality (BLMI) problem. We then propose an iterative algorithm to solve the BLMI problem that finds an optimal/suboptimal solution for the original RAB problem by solving the BLMI formulations. To validate our results, simulation examples are presented to demonstrate the improved array output SINR of the proposed robust beamformer. △ Less

Submitted 13 June, 2022; originally announced June 2022.

Convolutional Simultaneous Sparse Approximation with Applications to RGB-NIR Image Fusion

Authors: Farshad G. Veshki, Sergiy A. Vorobyov

Abstract: Simultaneous sparse approximation (SSA) seeks to represent a set of dependent signals using sparse vectors with identical supports. The SSA model has been used in various signal and image processing applications involving multiple correlated input signals. In this paper, we propose algorithms for convolutional SSA (CSSA) based on the alternating direction method of multipliers. Specifically, we ad… ▽ More Simultaneous sparse approximation (SSA) seeks to represent a set of dependent signals using sparse vectors with identical supports. The SSA model has been used in various signal and image processing applications involving multiple correlated input signals. In this paper, we propose algorithms for convolutional SSA (CSSA) based on the alternating direction method of multipliers. Specifically, we address the CSSA problem with different sparsity structures and the convolutional feature learning problem in multimodal data/signals based on the SSA model. We evaluate the proposed algorithms by applying them to multimodal and multifocus image fusion problems. △ Less

Submitted 18 March, 2022; originally announced March 2022.

Graph Convolutional Neural Networks Sensitivity under Probabilistic Error Model

Authors: Xinjue Wang, Esa Ollila, Sergiy A. Vorobyov

Abstract: Graph Neural Networks (GNNs), particularly Graph Convolutional Neural Networks (GCNNs), have emerged as pivotal instruments in machine learning and signal processing for processing graph-structured data. This paper proposes an analysis framework to investigate the sensitivity of GCNNs to probabilistic graph perturbations, directly impacting the graph shift operator (GSO). Our study establishes tig… ▽ More Graph Neural Networks (GNNs), particularly Graph Convolutional Neural Networks (GCNNs), have emerged as pivotal instruments in machine learning and signal processing for processing graph-structured data. This paper proposes an analysis framework to investigate the sensitivity of GCNNs to probabilistic graph perturbations, directly impacting the graph shift operator (GSO). Our study establishes tight expected GSO error bounds, which are explicitly linked to the error model parameters, and reveals a linear relationship between GSO perturbations and the resulting output differences at each layer of GCNNs. This linearity demonstrates that a single-layer GCNN maintains stability under graph edge perturbations, provided that the GSO errors remain bounded, regardless of the perturbation scale. For multilayer GCNNs, the dependency of system's output difference on GSO perturbations is shown to be a recursion of linearity. Finally, we exemplify the framework with the Graph Isomorphism Network (GIN) and Simple Graph Convolution Network (SGCN). Experiments validate our theoretical derivations and the effectiveness of our approach. △ Less

Submitted 6 May, 2024; v1 submitted 15 March, 2022; originally announced March 2022.

A New Class of Composite Objective Multi-step Estimating-sequence Techniques (COMET)

Authors: Endrit Dosti, Sergiy A. Vorobyov, Themistoklis Charalambous

Abstract: We devise a new accelerated gradient-based estimating sequence technique for solving large-scale optimization problems with composite structure. More specifically, we introduce a new class of estimating functions, which are obtained by utilizing a tight lower bound on the objective function. Then, by exploiting the coupling between the proposed estimating functions and the gradient map** techniq… ▽ More We devise a new accelerated gradient-based estimating sequence technique for solving large-scale optimization problems with composite structure. More specifically, we introduce a new class of estimating functions, which are obtained by utilizing a tight lower bound on the objective function. Then, by exploiting the coupling between the proposed estimating functions and the gradient map** technique, we construct a class of composite objective multi-step estimating-sequence techniques (COMET). We propose an efficient line search strategy for COMET, and prove that it enjoys an accelerated convergence rate. The established convergence results allow for step size adaptation. Our theoretical findings are supported by extensive computational experiments on various problem types and datasets. Moreover, our numerical results show evidence of the robustness of the proposed method to the imperfect knowledge of the smoothness and strong convexity parameters of the objective function. △ Less

Submitted 12 November, 2021; originally announced November 2021.

Comments: 31 pages, 3 figures

Robust Adaptive Beamforming Maximizing the Worst-Case SINR over Distributional Uncertainty Sets for Random INC Matrix and Signal Steering Vector

Authors: Yongwei Huang, Wenzheng Yang, Sergiy A. Vorobyov

Abstract: The robust adaptive beamforming (RAB) problem is considered via the worst-case signal-to-interference-plus-noise ratio (SINR) maximization over distributional uncertainty sets for the random interference-plus-noise covariance (INC) matrix and desired signal steering vector. The distributional uncertainty set of the INC matrix accounts for the support and the positive semidefinite (PSD) mean of the… ▽ More The robust adaptive beamforming (RAB) problem is considered via the worst-case signal-to-interference-plus-noise ratio (SINR) maximization over distributional uncertainty sets for the random interference-plus-noise covariance (INC) matrix and desired signal steering vector. The distributional uncertainty set of the INC matrix accounts for the support and the positive semidefinite (PSD) mean of the distribution, and a similarity constraint on the mean. The distributional uncertainty set for the steering vector consists of the constraints on the known first- and second-order moments. The RAB problem is formulated as a minimization of the worst-case expected value of the SINR denominator achieved by any distribution, subject to the expected value of the numerator being greater than or equal to one for each distribution. Resorting to the strong duality of linear conic programming, such a RAB problem is rewritten as a quadratic matrix inequality problem. It is then tackled by iteratively solving a sequence of linear matrix inequality relaxation problems with the penalty term on the rank-one PSD matrix constraint. To validate the results, simulation examples are presented, and they demonstrate the improved performance of the proposed robust beamformer in terms of the array output SINR. △ Less

Submitted 15 October, 2021; originally announced October 2021.

DOA Estimation in Nonuniform Sensor Noise

Authors: Majdoddin Esfandiari, Sergiy A. Vorobyov

Abstract: The problem of direction-of-arrival (DOA) estimation in the presence of nonuniform sensor noise is considered and a novel algorithm is developed. The algorithm consists of three phases. First, the diagonal nonuniform sensor noise covariance matrix is estimated using an iterative procedure that requires only few iterations to obtain an accurate estimate. The asymptotic variance of one iteration is… ▽ More The problem of direction-of-arrival (DOA) estimation in the presence of nonuniform sensor noise is considered and a novel algorithm is developed. The algorithm consists of three phases. First, the diagonal nonuniform sensor noise covariance matrix is estimated using an iterative procedure that requires only few iterations to obtain an accurate estimate. The asymptotic variance of one iteration is derived for the proposed noise covariance estimator. Second, a forward-only rooting-based DOA estimator as well as its forward-backward averaging extension are developed for DOA estimation. The DOA estimators take advantage of using second-order statistics of signal subspace perturbation in constructing a weight matrix of a properly designed generalized least squares minimization problem. Despite the fact that these DOA estimators are iterative, only a few iterations are sufficient to reach accurate results. The asymptotic performance of these DOA estimators is also investigated. Third, a newly designed DOA selection strategy with reasonable computational cost is developed to select L actual sources out of 2L candidates generated at the second phase. Numerical simulations are conducted in order to establish the considerable superiority of the proposed algorithm compared to the the existing state-of-the-art methods in challenging scenarios in both cases of uniform and nonuniform sensor noise. △ Less

Submitted 30 September, 2021; originally announced September 2021.

Efficient ADMM-based Algorithms for Convolutional Sparse Coding

Authors: Farshad G. Veshki, Sergiy A. Vorobyov

Abstract: Convolutional sparse coding improves on the standard sparse approximation by incorporating a global shift-invariant model. The most efficient convolutional sparse coding methods are based on the alternating direction method of multipliers and the convolution theorem. The only major difference between these methods is how they approach a convolutional least-squares fitting subproblem. This letter p… ▽ More Convolutional sparse coding improves on the standard sparse approximation by incorporating a global shift-invariant model. The most efficient convolutional sparse coding methods are based on the alternating direction method of multipliers and the convolution theorem. The only major difference between these methods is how they approach a convolutional least-squares fitting subproblem. This letter presents a solution to this subproblem, which improves the efficiency of the state-of-the-art algorithms. We also use the same approach for develo** an efficient convolutional dictionary learning method. Furthermore, we propose a novel algorithm for convolutional sparse coding with a constraint on the approximation error. △ Less

Submitted 7 September, 2021; originally announced September 2021.

Two-Dimensional DOA Estimation for L-shaped Nested Array via Tensor Modeling

Authors: Feng Xu, Sergiy A. Vorobyov

Abstract: The problem of two-dimensional (2-D) direction-of-arrival (DOA) estimation for the L-shaped nested array is considered. Typically, the multi-dimensional structure of the received signal in co-array domain is ignored in the problem considered. Moreover, the cross term generated by the correlated signal and noise components degrades the 2-D DOA estimation performance seriously. To tackle these issue… ▽ More The problem of two-dimensional (2-D) direction-of-arrival (DOA) estimation for the L-shaped nested array is considered. Typically, the multi-dimensional structure of the received signal in co-array domain is ignored in the problem considered. Moreover, the cross term generated by the correlated signal and noise components degrades the 2-D DOA estimation performance seriously. To tackle these issues, an iterative 2-D DOA estimation approach based on tensor modeling is proposed. To develop such approach, a higher-order tensor is constructed, whose factor matrices contain the sources azimuth and elevation information. By exploiting the Vandermonde structure of the factor matrix, a computationally efficient tensor decomposition method is then developed to estimate the sources DOA information in each dimension independently. The pair-matching of the azimuth and elevation angles is conducted via the cross-correlation matrix (CCM) of the received signals. An iterative method is further designed to improve the DOA estimation performance. Specifically, the cross term is estimated and removed in the next step of such iterative procedure on the basis of the DOA estimates originated from the tensor decomposition in the previous step. As a consequence, the DOA estimation with better accuracy and higher resolution is obtained. The proposed iterative 2-D DOA estimation method for the L-shaped nested array can resolve more sources than the number of real elements, which is superior to conventional approaches. Simulation results validate the performance improvement of the proposed 2-D DOA estimation method as compared to existing state-of-the-art DOA estimation techniques for the L-shaped nested array. △ Less

Submitted 3 June, 2022; v1 submitted 14 April, 2021; originally announced April 2021.

Comments: 14 pages, 7 figures, submit to IEEE Transactions on Signal Processing

Transmit Beamspace DDMA Based Automotive MIMO Radar

Authors: Feng Xu, Sergiy A. Vorobyov, Fawei Yang

Abstract: The time division multiple access (TDMA) technique has been applied in automotive multiple-input multiple-output (MIMO) radar. However, it suffers from the transmit energy loss, and as a result the parameter estimation performance degradation when the number of transmit elements increases. To tackle these problem, a transmit beamspace (TB) Doppler division multiple access (DDMA) approach is propos… ▽ More The time division multiple access (TDMA) technique has been applied in automotive multiple-input multiple-output (MIMO) radar. However, it suffers from the transmit energy loss, and as a result the parameter estimation performance degradation when the number of transmit elements increases. To tackle these problem, a transmit beamspace (TB) Doppler division multiple access (DDMA) approach is proposed. First, a phase modulation matrix with empty Doppler spectrum is introduced. By exploiting the empty Doppler spectrum, a test function based on sequential detection is developed to mitigate the Doppler ambiguity in DDMA waveform. Then, a discrete Fourier transform (DFT)-based TB in slow-time is formed.The proposed method can achieve waveform diversity in Doppler domain and generate a TB in slow-time that concentrates the transmitted power in a fixed spatial region to improve the transmit energy distribution for automotive MIMO radar, which is favored by medium/long range radar (MRR/LRR) applications. As compared to the conventional TDMA technique, the proposed TB DDMA approach can fully exploit the transmission capabilities of all transmit elements to ensure that the emitted power is efficiently used and inherits easy implementation. Moreover, the proposed TB DDMA method avoids the trade-off between the active time for each transmit antenna and the frame time. Simulation results verify the effectiveness of the proposed TB DDMA approach for automotive MIMO radar. △ Less

Submitted 25 March, 2021; originally announced March 2021.

Comments: 12 pages, 8 figures and 1 table, submit to IEEE Transactions on Vehicular Technology

Enhanced Robust Adaptive Beamforming Designs for General-Rank Signal Model via an Induced Norm of Matrix Errors

Authors: Yongwei Huang, Sergiy A. Vorobyov

Abstract: The robust adaptive beamforming (RAB) problem for general-rank signal model with an uncertainty set defined through a matrix induced norm is considered. The worst-case signal-to-interference-plus-noise ratio (SINR) maximization RAB problem is formulated by decomposing the presumed covariance of the desired signal into a product between a matrix and its Hermitian, and putting an error term into the… ▽ More The robust adaptive beamforming (RAB) problem for general-rank signal model with an uncertainty set defined through a matrix induced norm is considered. The worst-case signal-to-interference-plus-noise ratio (SINR) maximization RAB problem is formulated by decomposing the presumed covariance of the desired signal into a product between a matrix and its Hermitian, and putting an error term into the matrix and its Hermitian. In the literature, the norm of the matrix errors often is the Frobenius norm in the maximization problem. Herein, the closed-form optimal value for a minimization problem of the least-squares residual over the matrix errors with an induced $l_{p,q}$-norm constraint is first derived. Then, the worst-case SINR maximization problem is reformulated into the maximization of the difference between an $l_2$-norm function and a $l_q$-norm function, subject to a convex quadratic constraint. It is shown that for any $q$ in the set of rational numbers greater than or equal to one, the maximization problem can be approximated by a sequence of second-order cone programming (SOCP) problems, with the ascent optimal values. The resultant beamvector for some $q$ in the set, corresponding to the maximal actual array output SINR, is treated as the best candidate such that the RAB design is improved the most. In addition, a generalized RAB problem of maximizing the difference between an $l_p$-norm function and an $l_q$-norm function subject to the convex quadratic constraint is studied, and the actual array output SINR is further enhanced by properly selecting $p$ and $q$. Simulation examples are presented to demonstrate the improved performance of the robust beamformers for certain matrix induced $l_{p,q}$-norms, in terms of the actual array output SINR and the CPU-time for the sequential SOCP approximation algorithm. △ Less

Submitted 24 March, 2021; originally announced March 2021.

Comments: 8 pages, 4 figures

Coupled Feature Learning for Multimodal Medical Image Fusion

Authors: Farshad G. Veshki, Nora Ouzir, Sergiy A. Vorobyov, Esa Ollila

Abstract: Multimodal image fusion aims to combine relevant information from images acquired with different sensors. In medical imaging, fused images play an essential role in both standard and automated diagnosis. In this paper, we propose a novel multimodal image fusion method based on coupled dictionary learning. The proposed method is general and can be employed for different medical imaging modalities.… ▽ More Multimodal image fusion aims to combine relevant information from images acquired with different sensors. In medical imaging, fused images play an essential role in both standard and automated diagnosis. In this paper, we propose a novel multimodal image fusion method based on coupled dictionary learning. The proposed method is general and can be employed for different medical imaging modalities. Unlike many current medical fusion methods, the proposed approach does not suffer from intensity attenuation nor loss of critical information. Specifically, the images to be fused are decomposed into coupled and independent components estimated using sparse representations with identical supports and a Pearson correlation constraint, respectively. An alternating minimization algorithm is designed to solve the resulting optimization problem. The final fusion step uses the max-absolute-value rule. Experiments are conducted using various pairs of multimodal inputs, including real MR-CT and MR-PET images. The resulting performance and execution times show the competitiveness of the proposed method in comparison with state-of-the-art medical image fusion methods. △ Less

Submitted 17 February, 2021; originally announced February 2021.

ULA Fitting for Sparse Array Design

Authors: Wanlu Shi, Sergiy A. Vorobyov, Yingsong Li

Abstract: Sparse array (SA) geometries, such as coprime and nested arrays, can be regarded as a concatenation of two uniform linear arrays (ULAs). Such arrays lead to a significant increase of the number of degrees of freedom (DOF) when the second-order information is utilized, i.e., they provide long virtual difference coarray (DCA). Thus, the idea of this paper is based on the observation that SAs can be… ▽ More Sparse array (SA) geometries, such as coprime and nested arrays, can be regarded as a concatenation of two uniform linear arrays (ULAs). Such arrays lead to a significant increase of the number of degrees of freedom (DOF) when the second-order information is utilized, i.e., they provide long virtual difference coarray (DCA). Thus, the idea of this paper is based on the observation that SAs can be fitted through concatenation of sub-ULAs. A corresponding SA design principle, called ULA fitting, is then proposed. It aims to design SAs from sub-ULAs. Towards this goal, a polynomial model for arrays is used, and based on it, a DCA structure is analyzed if SA is composed of multiple sub-ULAs. SA design with low mutual coupling is considered. ULA fitting enables to transfer the SA design requirements, such as hole free, low mutual coupling and other requirements, into pseudo polynomial equation, and hence, find particular solutions. We mainly focus on designing SAs with low mutual coupling and large uniform DOF. Two examples of SAs with closed-form expressions are then developed based on ULA fitting. Numerical experiments verify the superiority of the proposed SAs in the presence of heavy mutual coupling. △ Less

Submitted 4 February, 2021; originally announced February 2021.

DOA Estimation for Transmit Beamspace MIMO Radar via Tensor Decomposition with Vandermonde Factor Matrix

Authors: Feng Xu, Matthew W. Morency, Sergiy A. Vorobyov

Abstract: We address the problem of tensor decomposition in application to direction-of-arrival (DOA) estimation for transmit beamspace (TB) multiple-input multiple-output (MIMO) radar. A general 4-order tensor model that enables computationally efficient DOA estimation is designed. Whereas other tensor decomposition-based methods treat all factor matrices as arbitrary, the essence of the proposed DOA estim… ▽ More We address the problem of tensor decomposition in application to direction-of-arrival (DOA) estimation for transmit beamspace (TB) multiple-input multiple-output (MIMO) radar. A general 4-order tensor model that enables computationally efficient DOA estimation is designed. Whereas other tensor decomposition-based methods treat all factor matrices as arbitrary, the essence of the proposed DOA estimation method is to fully exploit the Vandermonde structure of the factor matrices to take advantage of the shift-invariance between and within different subarrays. Specifically, the received signal of TB MIMO radar is expressed as a 4-order tensor. Depending on the target Doppler shifts, the constructed tensor is reshaped into two distinct 3-order tensors. A computationally efficient tensor decomposition method is proposed to decompose the Vandermonde factor matrices. The generators of the Vandermonde factor matrices are computed to estimate the phase rotations between subarrays, which can be utilized as a look-up table for finding target DOA. It is further shown that our proposed method can be used in a more general scenario where the subarray structures can be arbitrary but identical. The proposed DOA estimation method requires no prior information about the tensor rank and is guaranteed to achieve precise decomposition result. Simulation results illustrate the performance improvement of the proposed DOA estimation method as compared to conventional DOA estimation techniques for TB MIMO Radar. △ Less

Submitted 29 January, 2021; originally announced January 2021.

Comments: 14 pages, 9 figures, submitted to IEEE Transactions on Signal Processing

Graph Signal Processing Meets Blind Source Separation

Authors: Jari Miettinen, Eyal Nitzan, Sergiy A. Vorobyov, Esa Ollila

Abstract: In graph signal processing (GSP), prior information on the dependencies in the signal is collected in a graph which is then used when processing or analyzing the signal. Blind source separation (BSS) techniques have been developed and analyzed in different domains, but for graph signals the research on BSS is still in its infancy. In this paper, this gap is filled with two contributions. First, a… ▽ More In graph signal processing (GSP), prior information on the dependencies in the signal is collected in a graph which is then used when processing or analyzing the signal. Blind source separation (BSS) techniques have been developed and analyzed in different domains, but for graph signals the research on BSS is still in its infancy. In this paper, this gap is filled with two contributions. First, a nonparametric BSS method, which is relevant to the GSP framework, is refined, the Cramér-Rao bound (CRB) for mixing and unmixing matrix estimators in the case of Gaussian moving average graph signals is derived, and for studying the achievability of the CRB, a new parametric method for BSS of Gaussian moving average graph signals is introduced. Second, we also consider BSS of non-Gaussian graph signals and two methods are proposed. Identifiability conditions show that utilizing both graph structure and non-Gaussianity provides a more robust approach than methods which are based on only either graph dependencies or non-Gaussianity. It is also demonstrated by numerical study that the proposed methods are more efficient in separating non-Gaussian graph signals. △ Less

Submitted 24 August, 2020; originally announced August 2020.

Comments: 31 pages, 3 figures, 1 table, submitted to IEEE Trans. Signal Processing on Aug. 2020

Journal ref: IEEE Trans. Signal Processing, vol. 69, pp. 2585-2599, May 2021

Embedding a Heavy-Ball type of Momentum into the Estimating Sequences

Authors: Endrit Dosti, Sergiy A. Vorobyov, Themistoklis Charalambous

Abstract: We present a new accelerated gradient-based method for solving smooth unconstrained optimization problems. The goal is to embed a heavy-ball type of momentum into the Fast Gradient Method (FGM). For this purpose, we devise a generalization of the estimating sequences, which allows for encoding any form of information about the cost function that can aid in further accelerating the minimization pro… ▽ More We present a new accelerated gradient-based method for solving smooth unconstrained optimization problems. The goal is to embed a heavy-ball type of momentum into the Fast Gradient Method (FGM). For this purpose, we devise a generalization of the estimating sequences, which allows for encoding any form of information about the cost function that can aid in further accelerating the minimization process. In the black box framework, we propose a construction for the generalized estimating sequences, which is obtained by exploiting the history of the previously constructed estimating functions. From the viewpoint of efficiency estimates, we prove that the lower bound on the number of iterations for the proposed method is $\mathcal{O} \left(\sqrt{\fracκ{2}}\right)$. Our theoretical results are further corroborated by extensive numerical experiments on various types of optimization problems, often dealt within signal processing. Both synthetic and real-world datasets are utilized to demonstrate the efficiency of our proposed method in terms of decreasing the distance to the optimal solution, as well as in terms of decreasing the norm of the gradient. △ Less

Submitted 29 October, 2021; v1 submitted 18 August, 2020; originally announced August 2020.

Joint DOD and DOA Estimation in Slow-Time MIMO Radar via PARAFAC Decomposition

Authors: Feng Xu, Sergiy A. Vorobyov, Xiaopeng Yang

Abstract: We develop a new tensor model for slow-time multiple-input multiple output (MIMO) radar and apply it for joint direction-of-departure (DOD) and direction-of-arrival (DOA) estimation. This tensor model aims to exploit the independence of phase modulation matrix and receive array in the received signal for slow-time MIMO radar. Such tensor can be decomposed into two tensors of different ranks, one o… ▽ More We develop a new tensor model for slow-time multiple-input multiple output (MIMO) radar and apply it for joint direction-of-departure (DOD) and direction-of-arrival (DOA) estimation. This tensor model aims to exploit the independence of phase modulation matrix and receive array in the received signal for slow-time MIMO radar. Such tensor can be decomposed into two tensors of different ranks, one of which has identical structure to that of the conventional tensor model for MIMO radar, and the other contains all phase modulation values used in the transmit array. We then develop a modification of the alternating least squares algorithm to enable parallel factor decomposition of tensors with extra constants. The Vandermonde structure of the transmit and receive steering matrices (if both arrays are uniform and linear) is then utilized to obtain angle estimates from factor matrices. The multi-linear structure of the received signal is maintained to take advantage of tensor-based angle estimation algorithms, while the shortage of samples in Doppler domain for slow-time MIMO radar is mitigated. As a result, the joint DOD and DOA estimation performance is improved as compared to existing angle estimation techniques for slow-time MIMO radar. Simulation results verify the effectiveness of the proposed method. △ Less

Submitted 30 July, 2020; originally announced July 2020.

Comments: 6 double-column pages, 4 figures, submitted IEEE Signal Processing Letters

Journal ref: IEEE Signal Processing Letters, vol. 27, pp. 1495-1499, 2020

Lossless Size Reduction for Integer Least Squares with Application to Sphere Decoding

Authors: Mohammad Neinavaie, Mostafa Derakhtian, Sergiy A. Vorobyov

Abstract: Minimum achievable complexity (MAC) for a maximum likelihood (ML) performance-achieving detection algorithm is derived. Using the derived MAC, we prove that the conventional sphere decoding (SD) algorithms suffer from an inherent weakness at low SNRs. To find a solution for the low SNR deficiency, we analyze the effect of zero-forcing (ZF) and minimum mean square error (MMSE) detected symbols on t… ▽ More Minimum achievable complexity (MAC) for a maximum likelihood (ML) performance-achieving detection algorithm is derived. Using the derived MAC, we prove that the conventional sphere decoding (SD) algorithms suffer from an inherent weakness at low SNRs. To find a solution for the low SNR deficiency, we analyze the effect of zero-forcing (ZF) and minimum mean square error (MMSE) detected symbols on the MAC and demonstrate that although they both improve the SD algorithm in terms of the computational complexity, the MMSE point has a vital difference at low SNRs. By exploiting the information provided by the MMSE method, we prove the existence of a lossless size reduction which can be interpreted as the feasibility of a detection method which is capable of detecting the ML symbol without visiting any nodes at low and high SNRs. We also propose a lossless size reduction-aided detection method which achieves the promised complexity bounds marginally and reduces the overall computational complexity significantly, while obtaining the ML performance. The theoretical analysis is corroborated with numerical simulations. △ Less

Submitted 29 November, 2019; originally announced November 2019.

Comments: 13 double column pages, 8 figures, submitted to IEEE Trans. Signal Processing in November 2019

Journal ref: IEEE Trans. Signal Processing, vol. 68, pp. 6547-6561, Dec. 2020

Quadratic Matrix Inequality Approach to Robust Adaptive Beamforming for General-Rank Signal Model

Authors: Yongwei Huang, Sergiy A. Vorobyov, Zhi-Quan Luo

Abstract: The worst-case robust adaptive beamforming problem for general-rank signal model is considered. This is a nonconvex problem, and an approximate version of it (obtained by introducing a matrix decomposition on the presumed covariance matrix of the desired signal) has been well studied in the literature. Different from the existing literature, herein however the original beamforming problem is tackl… ▽ More The worst-case robust adaptive beamforming problem for general-rank signal model is considered. This is a nonconvex problem, and an approximate version of it (obtained by introducing a matrix decomposition on the presumed covariance matrix of the desired signal) has been well studied in the literature. Different from the existing literature, herein however the original beamforming problem is tackled. Resorting to the strong duality of linear conic programming, the robust adaptive beamforming problem for general-rank signal model is reformulated into an equivalent quadratic matrix inequality (QMI) problem. By employing a linear matrix inequality (LMI) relaxation technique, the QMI problem is turned into a convex semidefinite programming problem. Using the fact that there is often a positive gap between the QMI problem and its LMI relaxation, an approximate algorithm is proposed to solve the robust adaptive beamforming in the QMI form. Besides, several sufficient optimality conditions for the nonconvex QMI problem are built. To validate our results, simulation examples are presented, which also demonstrate the improved performance of the new robust beamformer in terms of the output signal-to-interference-plus-noise ratio. △ Less

Submitted 25 May, 2019; originally announced May 2019.

Journal ref: IEEE Trans. Signal Processing, vol. 68, pp. 2244-2255, 2020

Toward Millimeter Wave Joint Radar-Communications: A Signal Processing Perspective

Authors: Kumar Vijay Mishra, Bhavani Shankar M. R., Visa Koivunen, Björn Ottersten, Sergiy A. Vorobyov

Abstract: Synergistic design of communications and radar systems with common spectral and hardware resources is heralding a new era of efficiently utilizing a limited radio-frequency spectrum. Such a joint radar-communications (JRC) model has advantages of low-cost, compact size, less power consumption, spectrum sharing, improved performance, and safety due to enhanced information sharing. Today, millimeter… ▽ More Synergistic design of communications and radar systems with common spectral and hardware resources is heralding a new era of efficiently utilizing a limited radio-frequency spectrum. Such a joint radar-communications (JRC) model has advantages of low-cost, compact size, less power consumption, spectrum sharing, improved performance, and safety due to enhanced information sharing. Today, millimeter-wave (mm-wave) communications have emerged as the preferred technology for short distance wireless links because they provide transmission bandwidth that is several gigahertz wide. This band is also promising for short-range radar applications, which benefit from the high-range resolution arising from large transmit signal bandwidths. Signal processing techniques are critical in implementation of mmWave JRC systems. Major challenges are joint waveform design and performance criteria that would optimally trade-off between communications and radar functionalities. Novel multiple-input-multiple-output (MIMO) signal processing techniques are required because mmWave JRC systems employ large antenna arrays. There are opportunities to exploit recent advances in cognition, compressed sensing, and machine learning to reduce required resources and dynamically allocate them with low overheads. This article provides a signal processing perspective of mmWave JRC systems with an emphasis on waveform design. △ Less

Submitted 18 May, 2019; v1 submitted 2 May, 2019; originally announced May 2019.

Comments: 24 pages, 6 figures, IEEE Signal Processing Magazine

Journal ref: IEEE Signal Processing Magazine, vol. 36, no. 5, pp. 100-114, Sept. 2019

A Fast Dictionary Learning Method for Coupled Feature Space Learning

Authors: F. G. Veshki, S. A. Vorobyov

Abstract: In this letter, we propose a novel computationally efficient coupled dictionary learning method that enforces pairwise correlation between the atoms of dictionaries learned to represent the underlying feature spaces of two different representations of the same signals, e.g., representations in different modalities or representations of the same signals measured with different qualities. The jointl… ▽ More In this letter, we propose a novel computationally efficient coupled dictionary learning method that enforces pairwise correlation between the atoms of dictionaries learned to represent the underlying feature spaces of two different representations of the same signals, e.g., representations in different modalities or representations of the same signals measured with different qualities. The jointly learned correlated feature spaces represented by coupled dictionaries are used in sparse representation based classification, recognition and reconstruction tasks. The presented experimental results show that the proposed coupled dictionary learning method has a significantly lower computational cost. Moreover, the visual presentation of jointly learned dictionaries shows that the pairwise correlations between the corresponding atoms are ensured. △ Less

Submitted 15 April, 2019; originally announced April 2019.

Comments: 12 pages, 3 figures, 1 algorithm

Journal ref: IEEE Signal Processing Letters, vol. 26, no. 10, pp. 1441-1445, Oct. 2019

Adaptive Virtual Waveform Design for Millimeter-Wave Joint Communication-Radar

Authors: Preeti Kumari, Sergiy A. Vorobyov, Robert W. Heath Jr

Abstract: Joint communication and radar (JCR) waveforms with fully digital baseband generation and processing can now be realized at the millimeter-wave (mmWave) band. Prior work has proposed a mmWave wireless local area network (WLAN)-based JCR that exploits the WLAN preamble for radars. The performance of target velocity estimation, however, was limited. In this paper, we propose a virtual waveform design… ▽ More Joint communication and radar (JCR) waveforms with fully digital baseband generation and processing can now be realized at the millimeter-wave (mmWave) band. Prior work has proposed a mmWave wireless local area network (WLAN)-based JCR that exploits the WLAN preamble for radars. The performance of target velocity estimation, however, was limited. In this paper, we propose a virtual waveform design for an adaptive mmWave JCR. The proposed system transmits a few non-uniformly placed preambles to construct several receive virtual preambles for enhancing velocity estimation accuracy, at the cost of only a small reduction in the communication data rate. We evaluate JCR performance trade-offs using the Cramer-Rao Bound (CRB) metric for radar estimation and a novel distortion minimum mean square error (MMSE) metric for data communication. Additionally, we develop three different MMSE-based optimization problems for the adaptive JCR waveform design. Simulations show that an optimal virtual (non-uniform) waveform achieves a significant performance improvement as compared to a uniform waveform. For a radar CRB constrained optimization, the optimal radar range of operation and the optimal communication distortion MMSE (DMMSE) are improved. For a communication DMMSE constrained optimization with a high DMMSE constraint, the optimal radar CRB is enhanced. For a weighted MMSE average optimization, the advantage of the virtual waveform over the uniform waveform is increased with decreased communication weighting. Comparison of MMSE-based optimization with traditional virtual preamble count-based optimization indicated that the conventional solution converges to the MMSE-based one only for a small number of targets and a high signal-to-noise ratio. △ Less

Submitted 10 April, 2019; originally announced April 2019.

Journal ref: IEEE Trans. Signal Processing, vol. 68, pp. 715-730, 2020

On the Spectral Efficiency for Massive MIMO Systems With Imperfect Spacial Covariance Information

Authors: A. K. Kocharlakota, K. Upadhya, S. A. Vorobyov

Abstract: This paper studies the impact of imperfect channel covariance information on the uplink (UL) and downlink (DL) spectral efficiencies (SEs) of a time-division duplexed (TDD) massive multiple-input multiple-output (MIMO) system. We derive closed-form expressions for the UL and DL average SEs by considering linear minimum mean squared (LMMSE)-type and element-wise LMMSE-type channel estimation that r… ▽ More This paper studies the impact of imperfect channel covariance information on the uplink (UL) and downlink (DL) spectral efficiencies (SEs) of a time-division duplexed (TDD) massive multiple-input multiple-output (MIMO) system. We derive closed-form expressions for the UL and DL average SEs by considering linear minimum mean squared (LMMSE)-type and element-wise LMMSE-type channel estimation that represent LMMSE and element-wise LMMSE with estimated covariance matrices, respectively. The closed-form expressions of these average SEs are functions of the number of observations used for estimating the spatial covariance matrices of individual and contaminated channels of a target user, and thus enable us to select these key parameters to achieve the desired SE. We present a theoretical analysis of SE behavior for different values of these parameters, followed by simulations, which also demonstrate and validate this behavior. Specifically, we present the SEs computed using estimated covariance matrices and show the accurate agreement between the theoretical and simulated SEs as functions of the number of observations for estimating the covariance matrices of individual and contaminated channels of a user. We also compare these SEs across channel estimation techniques using analytical and simulation studies. △ Less

Submitted 12 September, 2019; v1 submitted 28 March, 2019; originally announced March 2019.

Comments: 30 pages, 7 figures, Submitted to IEEE Trans. Wireless Communications on March 2019

Non-Iterative Subspace-Based DOA Estimation in the Presence of Nonuniform Noise

Authors: M. Esfandiari, S. A. Vorobyov, S. Aliban, M. Karimi

Abstract: The uniform white noise assumption is one of the basic assumptions in most of the existing directional-of-arrival (DOA) estimation methods. In many applications, however, the non-uniform white noise model is more adequate. Then the noise variances at different sensors have to be also estimated as nuisance parameters while estimating DOAs. In this letter, different from the existing iterative metho… ▽ More The uniform white noise assumption is one of the basic assumptions in most of the existing directional-of-arrival (DOA) estimation methods. In many applications, however, the non-uniform white noise model is more adequate. Then the noise variances at different sensors have to be also estimated as nuisance parameters while estimating DOAs. In this letter, different from the existing iterative methods that address the problem of non-uniform noise, a non-iterative two-phase subspace-based DOA estimation method is proposed. The first phase of the method is based on estimating the noise subspace via eigendecomposition (ED) of some properly designed matrix and it avoids estimating the noise covariance matrix. In the second phase, the results achieved in the first phase are used to estimate the noise covariance matrix, followed by estimating the noise subspace via generalized ED. Since the proposed method estimates DOAs in a non-iterative manner, it is computationally more efficient and has no convergence issues as compared to the existing methods. Simulation results demonstrate better performance of the proposed method as compared to other existing state-of-the-art methods. △ Less

Submitted 27 March, 2019; originally announced March 2019.

Comments: 12 pages, 2 figures, 1 table. Accepted for publication in IEEE Signal Processing Letters

Journal ref: IEEE Signal Processing Letters, vol. 26, no. 6, pp. 848-852, June 2019

Modelling Graph Errors: Towards Robust Graph Signal Processing

Authors: Jari Miettinen, Sergiy A. Vorobyov, Esa Ollila

Abstract: The first step for any graph signal processing (GSP) procedure is to learn the graph signal representation, i.e., to capture the dependence structure of the data into an adjacency matrix. Indeed, the adjacency matrix is typically not known a priori and has to be learned. However, it is learned with errors. A little attention has been paid to modelling such errors in the adjacency matrix, and study… ▽ More The first step for any graph signal processing (GSP) procedure is to learn the graph signal representation, i.e., to capture the dependence structure of the data into an adjacency matrix. Indeed, the adjacency matrix is typically not known a priori and has to be learned. However, it is learned with errors. A little attention has been paid to modelling such errors in the adjacency matrix, and studying their effects on GSP methods. However, modelling errors in the adjacency matrix will enable both to study the graph error effects in GSP and to develop robust GSP algorithms. In this paper, we therefore introduce practically justifiable graph error models. We also study, both analytically when possible and numerically, the graph error effect on the performance of GSP methods in different types of problems such as filtering of graph signals and independent component analysis of graph signals (graph decorrelation). △ Less

Submitted 25 September, 2020; v1 submitted 20 March, 2019; originally announced March 2019.

Comments: 34 pages, 6 figures, 2 tables, Submitted to IEEE journal on January 2019

Journal ref: Signal Processing, vol. 189, 108256, pp. 1-8, Dec. 2021

New Designs on MVDR Robust Adaptive Beamforming Based on Optimal Steering Vector Estimation

Authors: Yongwei Huang, Mingkang Zhou, Sergiy A. Vorobyov

Abstract: The robust adaptive beamforming design problem based on estimation of the signal of interest steering vector is considered in the paper. In this case, the optimal beamformer is obtained by computing the sample matrix inverse and an optimal estimate of the signal of interest steering vector. The common criteria to find the best estimate of the steering vector are the beamformer output SINR and outp… ▽ More The robust adaptive beamforming design problem based on estimation of the signal of interest steering vector is considered in the paper. In this case, the optimal beamformer is obtained by computing the sample matrix inverse and an optimal estimate of the signal of interest steering vector. The common criteria to find the best estimate of the steering vector are the beamformer output SINR and output power, while the constraints assume as little as possible prior inaccurate knowledge about the signal of interest, the propagation media, and the antenna array. Herein, a new beamformer output power maximization problem is formulated and solved subject to a double-sided norm perturbation constraint, a similarity constraint, and a quadratic constraint that guarantees that the direction-of-arrival (DOA) of the signal of interest is away from the DOA region of all linear combinations of the interference steering vectors. In the new robust design, the prior information required consists of some allowable error norm bounds, the approximate knowledge of the antenna array geometry, and the angular sector of the signal of interest. It turns out that the array output power maximization problem is a non-convex QCQP problem with inhomogeneous constraints. However, we show that the problem is still solvable, and develop efficient algorithms for finding globally optimal estimate of the signal of interest steering vector. The results are generalized to the case where an ellipsoidal constraint is considered, and sufficient conditions for the global optimality are derived. In addition, a new quadratic constraint on the actual signal steering vector is proposed in order to improve the array performance. To validate our results, simulation examples are presented, and they demonstrate the improved performance of the new robust beamformers in terms of the output SINR as well as the output power. △ Less

Submitted 26 October, 2018; originally announced October 2018.

Joint Detection and Localization of an Unknown Number of Sources Using Algebraic Structure of the Noise Subspace

Authors: Matthew W. Morency, Sergiy A. Vorobyov, Geert Leus

Abstract: Source localization and spectral estimation are among the most fundamental problems in statistical and array signal processing. Methods which rely on the orthogonality of the signal and noise subspaces, such as Pisarenko's method, MUSIC, and root-MUSIC are some of the most widely used algorithms to solve these problems. As a common feature, these methods require both apriori knowledge of the numbe… ▽ More Source localization and spectral estimation are among the most fundamental problems in statistical and array signal processing. Methods which rely on the orthogonality of the signal and noise subspaces, such as Pisarenko's method, MUSIC, and root-MUSIC are some of the most widely used algorithms to solve these problems. As a common feature, these methods require both apriori knowledge of the number of sources, and an estimate of the noise subspace. Both requirements are complicating factors to the practical implementation of the algorithms, and when not satisfied exactly, can potentially lead to severe errors. In this paper, we propose a new localization criterion based on the algebraic structure of the noise subspace that is described for the first time to the best of our knowledge. Using this criterion and the relationship between the source localization problem and the problem of computing the greatest common divisor (GCD), or more practically approximate GCD, for polynomials, we propose two algorithms which adaptively learn the number of sources and estimate their locations. Simulation results show a significant improvement over root-MUSIC in challenging scenarios such as closely located sources, both in terms of detection of the number of sources and their localization over a broad and practical range of SNRs. Further, no performance sacrifice in simple scenarios is observed. △ Less

Submitted 22 May, 2018; originally announced May 2018.

Comments: 16 two-column pages, 12 figures, 1 table, Submitted for publication in IEEE Trans. Signal Processing

Journal ref: IEEE Trans. Signal Processing, vol. 66, no. 17, pp. 4685-4700, Sept. 2018

An Inner SOCP Approximate Algorithm for Robust Adaptive Beamforming for General-Rank Signal Model

Authors: Yongwei Huang, Sergiy A. Vorobyov

Abstract: The worst-case robust adaptive beamforming problem for general-rank signal model is considered. Its formulation is to maximize the worst-case signal-to-interference-plus-noise ratio (SINR), incorporating a positive semidefinite constraint on the actual covariance matrix of the desired signal. In the literature, semidefinite program (SDP) techniques, together with others, have been applied to appro… ▽ More The worst-case robust adaptive beamforming problem for general-rank signal model is considered. Its formulation is to maximize the worst-case signal-to-interference-plus-noise ratio (SINR), incorporating a positive semidefinite constraint on the actual covariance matrix of the desired signal. In the literature, semidefinite program (SDP) techniques, together with others, have been applied to approximately solve this problem. Herein an inner second-order cone program (SOCP) approximate algorithm is proposed to solve it. In particular, a sequence of SOCPs are constructed and solved, while the SOCPs have the nondecreasing optimal values and converge to a locally optimal value (it is in fact a globally optimal value through our extensive simulations). As a result, our algorithm does not use computationally heavy SDP relaxation technique. To validate our inner approximation results, simulation examples are presented, and they demonstrate the improved performance of the new robust beamformer in terms of the averaged cpu-time (indicating how fast the algorithms converge) in a high signal-to-noise region. △ Less

Submitted 12 May, 2018; originally announced May 2018.

Covariance Matrix Estimation for Massive MIMO

Authors: Karthik Upadhya, Sergiy A. Vorobyov

Abstract: We propose a novel pilot structure for covariance matrix estimation in massive multiple-input multiple-output (MIMO) systems in which each user transmits two pilot sequences, with the second pilot sequence multiplied by a random phase-shift. The covariance matrix of a particular user is obtained by computing the sample cross-correlation of the channel estimates obtained from the two pilot sequence… ▽ More We propose a novel pilot structure for covariance matrix estimation in massive multiple-input multiple-output (MIMO) systems in which each user transmits two pilot sequences, with the second pilot sequence multiplied by a random phase-shift. The covariance matrix of a particular user is obtained by computing the sample cross-correlation of the channel estimates obtained from the two pilot sequences. This approach relaxes the requirement that all the users transmit their uplink pilots over the same set of symbols. We derive expressions for the achievable rate and the mean-squared error of the covariance matrix estimate when the proposed method is used with staggered pilots. The performance of the proposed method is compared with existing methods through simulations. △ Less

Submitted 7 March, 2018; v1 submitted 5 February, 2018; originally announced February 2018.

Comments: 6 pages, 4 figures. Accepted for publication in IEEE Signal Processing Letters

Journal ref: K. Upadhya and S.A. Vorobyov, "Covariance matrix estimation for massive MIMO," IEEE Signal Processing Letters, vol. 25, no. 4, pp. 546-550, Apr. 2018

An axially-variant kernel imaging model applied to ultrasound image reconstruction

Authors: Mihai I. Florea, Adrian Basarab, Denis Kouamé, Sergiy A. Vorobyov

Abstract: Existing ultrasound deconvolution approaches unrealistically assume, primarily for computational reasons, that the convolution model relies on a spatially invariant kernel and circulant boundary conditions. We discard both restrictions and introduce an image formation model applicable to ultrasound imaging and deconvolution based on an axially varying kernel, that accounts for arbitrary boundary c… ▽ More Existing ultrasound deconvolution approaches unrealistically assume, primarily for computational reasons, that the convolution model relies on a spatially invariant kernel and circulant boundary conditions. We discard both restrictions and introduce an image formation model applicable to ultrasound imaging and deconvolution based on an axially varying kernel, that accounts for arbitrary boundary conditions. Our model has the same computational complexity as the one employing spatially invariant convolution and has negligible memory requirements. To accommodate state-of-the-art deconvolution approaches when applied to a variety of inverse problem formulations, we also provide an equally efficient adjoint expression of our model. Simulation results confirm the tractability of our model for the deconvolution of large images. Moreover, the quality of reconstruction using our model is superior to that obtained using spatially invariant convolution. △ Less

Submitted 27 March, 2018; v1 submitted 25 January, 2018; originally announced January 2018.

MSC Class: 92C55

Journal ref: IEEE Signal Processing Letters, vol. 25, no. 7, pp. 961-965, July 2018

Multi-Focus Image Fusion Using Sparse Representation and Coupled Dictionary Learning

Authors: Farshad G. Veshki, Sergiy A. Vorobyov

Abstract: We address the multi-focus image fusion problem, where multiple images captured with different focal settings are to be fused into an all-in-focus image of higher quality. Algorithms for this problem necessarily admit the source image characteristics along with focused and blurred features. However, most sparsity-based approaches use a single dictionary in focused feature space to describe multi-f… ▽ More We address the multi-focus image fusion problem, where multiple images captured with different focal settings are to be fused into an all-in-focus image of higher quality. Algorithms for this problem necessarily admit the source image characteristics along with focused and blurred features. However, most sparsity-based approaches use a single dictionary in focused feature space to describe multi-focus images, and ignore the representations in blurred feature space. We propose a multi-focus image fusion approach based on sparse representation using a coupled dictionary. It exploits the observations that the patches from a given training set can be sparsely represented by a couple of overcomplete dictionaries related to the focused and blurred categories of images and that a sparse approximation based on such coupled dictionary leads to a more flexible and therefore better fusion strategy than the one based on just selecting the sparsest representation in the original image estimate. In addition, to improve the fusion performance, we employ a coupled dictionary learning approach that enforces pairwise correlation between atoms of dictionaries learned to represent the focused and blurred feature spaces. We also discuss the advantages of the fusion approach based on coupled dictionary learning, and present efficient algorithms for fusion based on coupled dictionary learning. Extensive experimental comparisons with state-of-the-art multi-focus image fusion algorithms validate the effectiveness of the proposed approach. △ Less

Submitted 3 May, 2019; v1 submitted 30 May, 2017; originally announced May 2017.

Comments: 25 pages, 15 figures, 2 table

A Generalized Accelerated Composite Gradient Method: Uniting Nesterov's Fast Gradient Method and FISTA

Authors: Mihai I. Florea, Sergiy A. Vorobyov

Abstract: The most popular first-order accelerated black-box methods for solving large-scale convex optimization problems are the Fast Gradient Method (FGM) and the Fast Iterative Shrinkage Thresholding Algorithm (FISTA). FGM requires that the objective be finite and differentiable with known gradient Lipschitz constant. FISTA is applicable to the more broad class of composite objectives and is equipped wit… ▽ More The most popular first-order accelerated black-box methods for solving large-scale convex optimization problems are the Fast Gradient Method (FGM) and the Fast Iterative Shrinkage Thresholding Algorithm (FISTA). FGM requires that the objective be finite and differentiable with known gradient Lipschitz constant. FISTA is applicable to the more broad class of composite objectives and is equipped with a line-search procedure for estimating the Lipschitz constant. Nonetheless, FISTA cannot increase the step size and is unable to take advantage of strong convexity. FGM and FISTA are very similar in form. Despite this, they appear to have vastly differing convergence analyses. In this work we generalize the previously introduced augmented estimate sequence framework as well as the related notion of the gap sequence. We showcase the flexibility of our tools by constructing a Generalized Accelerated Composite Gradient Method, that unites FGM and FISTA, along with their most popular variants. The Lyapunov property of the generalized gap sequence used in deriving our method implies that both FGM and FISTA are amenable to a Lyapunov analysis, common among optimization algorithms. We further showcase the flexibility of our tools by endowing our method with monotonically decreasing objective function values alongside a versatile line-search procedure. By simultaneously incorporating the strengths of FGM and FISTA, our method is able to surpass both in terms of robustness and usability. We support our findings with simulation results on an extensive benchmark of composite problems. Our experiments show that monotonicity has a stabilizing effect on convergence and challenge the notion present in the literature that for strongly convex objectives, accelerated proximal schemes can be reduced to fixed momentum methods. △ Less

Submitted 28 October, 2019; v1 submitted 29 May, 2017; originally announced May 2017.

MSC Class: 90C06; 68Q25; 90C25

Journal ref: IEEE Trans. Signal Processing, vol. 68, pp. 3033-3048, 2020

Transmit Array Interpolation for DOA Estimation via Tensor Decomposition in 2D MIMO Radar

Authors: Ming-Yang Cao, Sergiy A. Vorobyov, Aboulnasr Hassanien

Abstract: In this paper, we propose a two-dimensional (2D) joint transmit array interpolation and beamspace design for planar array mono-static multiple-input-multiple-output (MIMO) radar for direction-of-arrival (DOA) estimation via tensor modeling. Our underlying idea is to map the transmit array to a desired array and suppress the transmit power outside the spatial sector of interest. In doing so, the si… ▽ More In this paper, we propose a two-dimensional (2D) joint transmit array interpolation and beamspace design for planar array mono-static multiple-input-multiple-output (MIMO) radar for direction-of-arrival (DOA) estimation via tensor modeling. Our underlying idea is to map the transmit array to a desired array and suppress the transmit power outside the spatial sector of interest. In doing so, the signal-tonoise ratio is improved at the receive array. Then, we fold the received data along each dimension into a tensorial structure and apply tensor-based methods to obtain DOA estimates. In addition, we derive a close-form expression for DOA estimation bias caused by interpolation errors and argue for using a specially designed look-up table to compensate the bias. The corresponding Cramer-Rao Bound (CRB) is also derived. Simulation results are provided to show the performance of the proposed method and compare its performance to CRB. △ Less

Submitted 5 May, 2017; originally announced May 2017.

Comments: 37 pages, 13 figures, Submitted to the IEEE Trans. Signal Processing in December 2016

Journal ref: IEEE Transaction on Signal Processing, vol. 65, no. 19, pp. 5225-5239, Oct. 2017

Image Fusion With Cosparse Analysis Operator

Authors: Rui Gao, Sergiy A. Vorobyov, Hong Zhao

Abstract: The paper addresses the image fusion problem, where multiple images captured with different focus distances are to be combined into a higher quality all-in-focus image. Most current approaches for image fusion strongly rely on the unrealistic noise-free assumption used during the image acquisition, and then yield limited robustness in fusion processing. In our approach, we formulate the multi-focu… ▽ More The paper addresses the image fusion problem, where multiple images captured with different focus distances are to be combined into a higher quality all-in-focus image. Most current approaches for image fusion strongly rely on the unrealistic noise-free assumption used during the image acquisition, and then yield limited robustness in fusion processing. In our approach, we formulate the multi-focus image fusion problem in terms of an analysis sparse model, and simultaneously perform the restoration and fusion of multi-focus images. Based on this model, we propose an analysis operator learning, and define a novel fusion function to generate an all-in-focus image. Experimental evaluations confirm the effectiveness of the proposed fusion approach both visually and quantitatively, and show that our approach outperforms state-of-the-art fusion methods. △ Less

Submitted 18 April, 2017; originally announced April 2017.

Comments: 12 pages, 4 figures, 1 table, Submitted to IEEE Signal Processing Letters on December 2016

Journal ref: IEEE Signal Processing Letters, vol. 24, no. 7, pp. 943-947, July 2017

Fast Algorithms for Designing Multiple Unimodular Waveforms With Good Correlation Properties

Authors: Yongzhe Li, Sergiy A. Vorobyov

Abstract: In this paper, we develop new fast and efficient algorithms for designing single/multiple unimodular waveforms/codes with good auto- and cross-correlation or weighted correlation properties, which are highly desired in radar and communication systems. The waveform design is based on the minimization of the integrated sidelobe level (ISL) and weighted ISL (WISL) of waveforms. As the corresponding o… ▽ More In this paper, we develop new fast and efficient algorithms for designing single/multiple unimodular waveforms/codes with good auto- and cross-correlation or weighted correlation properties, which are highly desired in radar and communication systems. The waveform design is based on the minimization of the integrated sidelobe level (ISL) and weighted ISL (WISL) of waveforms. As the corresponding optimization problems can quickly grow to large scale with increasing the code length and number of waveforms, the main issue turns to be the development of fast large-scale optimization techniques. The difficulty is also that the corresponding optimization problems are non-convex, but the required accuracy is high. Therefore, we formulate the ISL and WISL minimization problems as non-convex quartic optimization problems in frequency domain, and then simplify them into quadratic problems by utilizing the majorization-minimization technique, which is one of the basic techniques for addressing large-scale and/or non-convex optimization problems. While designing our fast algorithms, we find out and use inherent algebraic structures in the objective functions to rewrite them into quartic forms, and in the case of WISL minimization, to derive additionally an alternative quartic form which allows to apply the quartic-quadratic transformation. Our algorithms are applicable to large-scale unimodular waveform design problems as they are proved to have lower or comparable computational burden (analyzed theoretically) and faster convergence speed (confirmed by comprehensive simulations) than the state-of-the-art algorithms. In addition, the waveforms designed by our algorithms demonstrate better correlation properties compared to their counterparts. △ Less

Submitted 22 February, 2017; originally announced February 2017.

Comments: 30 pages, 3 figures

Journal ref: IEEE Transactions on Signal Processing. vol. 66, no. 5, pp. 1197-1212, Mar. 2018

An Accelerated Composite Gradient Method for Large-scale Composite Objective Problems

Authors: Mihai I. Florea, Sergiy A. Vorobyov

Abstract: We introduce a framework, which we denote as the augmented estimate sequence, for deriving fast algorithms with provable convergence guarantees. We use this framework to construct a new first-order scheme, the Accelerated Composite Gradient Method (ACGM), for large-scale problems with composite objective structure. ACGM surpasses the state-of-the-art methods for this problem class in terms of prov… ▽ More We introduce a framework, which we denote as the augmented estimate sequence, for deriving fast algorithms with provable convergence guarantees. We use this framework to construct a new first-order scheme, the Accelerated Composite Gradient Method (ACGM), for large-scale problems with composite objective structure. ACGM surpasses the state-of-the-art methods for this problem class in terms of provable convergence rate, both in the strongly and non-strongly convex cases, and is endowed with an efficient step size search procedure. We support the effectiveness of our new method with simulation results. △ Less

Submitted 5 April, 2017; v1 submitted 7 December, 2016; originally announced December 2016.

MSC Class: 90C06; 68Q25; 90C25

Journal ref: IEEE Trans. Signal Processing, vol. 67, no. 2, pp. 444-459, Jan. 2019

An Algebraic Approach to a Class of Rank-Constrained Semi-Definite Programs With Applications

Authors: Matthew W. Morency, Sergiy A. Vorobyov

Abstract: A new approach to solving a class of rankconstrained semi-definite programming (SDP) problems, which appear in many signal processing applications such as transmit beamspace design in multiple-input multiple-output (MIMO) radar, downlink beamforming design in MIMO communications, generalized sidelobe canceller design, phase retrieval, etc., is presented. The essence of the approach is the use of u… ▽ More A new approach to solving a class of rankconstrained semi-definite programming (SDP) problems, which appear in many signal processing applications such as transmit beamspace design in multiple-input multiple-output (MIMO) radar, downlink beamforming design in MIMO communications, generalized sidelobe canceller design, phase retrieval, etc., is presented. The essence of the approach is the use of underlying algebraic structure enforced in such problems by other practical constraints such as, for example, null sha** constraint. According to this approach, instead of relaxing the non-convex rankconstrained SDP problem to a feasible set of positive semidefinite matrices, we restrict it to a space of polynomials whose dimension is equal to the desired rank. The resulting optimization problem is then convex as its solution is required to be full rank, and can be efficiently and exactly solved. A simple matrix decomposition is needed to recover the solution of the original problem from the solution of the restricted one. We show how this approach can be applied to solving some important signal processing problems that contain null-sha** constraints. As a byproduct of our study, the conjugacy of beamfoming and parameter estimation problems leads us to formulation of a new and rigorous criterion for signal/noise subspace identification. Simulation results are performed for the problem of rank-constrained beamforming design and show an exact agreement of the solution with the proposed algebraic structure, as well as significant performance improvements in terms of sidelobe suppression compared to the existing methods. △ Less

Submitted 7 October, 2016; originally announced October 2016.

Comments: 12 two columns pages, 5 figures, Submitted to IEEE Trans. Signal Processing on September 2016

Downlink Performance of Superimposed Pilots in Massive MIMO systems

Authors: Karthik Upadhya, Sergiy A. Vorobyov, Mikko Vehkapera

Abstract: In this paper, we investigate the downlink throughput performance of a massive multiple-input multiple-output (MIMO) system that employs superimposed pilots for channel estimation. The component of downlink (DL) interference that results from transmitting data alongside pilots in the uplink (UL) is shown to decrease at a rate proportional to the square root of the number of antennas at the BS. The… ▽ More In this paper, we investigate the downlink throughput performance of a massive multiple-input multiple-output (MIMO) system that employs superimposed pilots for channel estimation. The component of downlink (DL) interference that results from transmitting data alongside pilots in the uplink (UL) is shown to decrease at a rate proportional to the square root of the number of antennas at the BS. The normalized mean-squared error (NMSE) of the channel estimate is compared with the Bayesian Cramér-Rao lower bound that is derived for the system, and the former is also shown to diminish with increasing number of antennas at the base station (BS). Furthermore, we show that staggered pilots are a particular case of superimposed pilots and offer the downlink throughput of superimposed pilots while retaining the UL spectral and energy efficiency of regular pilots. We also extend the framework for designing a hybrid system, consisting of users that transmit either regular or superimposed pilots, to minimize both the UL and DL interference. The improved NMSE and DL rates of the channel estimator based on superimposed pilots are demonstrated by means of simulations. △ Less

Submitted 20 March, 2018; v1 submitted 14 June, 2016; originally announced June 2016.

Comments: 28 single-column pages, 6 figures, 1 table, Submitted to IEEE Trans. Wireless Commun. in Aug 2017. Revised Submission in Feb. 2018

Journal ref: IEEE Trans. Wireless Communications, vol. 17, no. 10, pp. 6630-6644, Oct. 2018

Superimposed Pilots are Superior for Mitigating Pilot Contamination in Massive MIMO

Authors: Karthik Upadhya, Sergiy A. Vorobyov, Mikko Vehkapera

Abstract: In this paper, superimposed pilots are introduced as an alternative to time-multiplexed pilot and data symbols for mitigating pilot contamination in massive multiple-input multiple-output (MIMO) systems. We propose a non-iterative scheme for uplink channel estimation based on superimposed pilots and derive an expression for the uplink signal-to-interference-plus-noise ratio (SINR) at the output of… ▽ More In this paper, superimposed pilots are introduced as an alternative to time-multiplexed pilot and data symbols for mitigating pilot contamination in massive multiple-input multiple-output (MIMO) systems. We propose a non-iterative scheme for uplink channel estimation based on superimposed pilots and derive an expression for the uplink signal-to-interference-plus-noise ratio (SINR) at the output of a matched filter employing this channel estimate. Based on this expression, we observe that power control is essential when superimposed pilots are employed. Moreover, the quality of the channel estimate can be improved by reducing the interference that results from transmitting data alongside the pilots, and an intuitive iterative data-aided scheme that reduces this component of interference is also proposed. Approximate expressions for the uplink SINR are provided for the iterative data-aided method as well. In addition, we show that a hybrid system with users utilizing both time-multiplexed and superimposed pilots is superior to an optimally designed system that employs only time-multiplexed pilots, even when the non-iterative channel estimate is used to build the detector and precoder. We also describe a simple approach to implement this hybrid system by minimizing the overall inter and intra-cell interference. Numerical simulations demonstrating the performance of the proposed channel estimation schemes and the superiority of the hybrid system are also provided. △ Less

Submitted 2 August, 2017; v1 submitted 2 March, 2016; originally announced March 2016.

Comments: 16 two-column pages, 5 figures, Accepted for publication in IEEE Trans. Signal Processing

Journal ref: IEEE Trans. Signal Processing, vol. 65, no. 11, pp. 2917-2932, June 2017

Joint Robust Transmit/Receive Adaptive Beamforming for MIMO Radar Using Probability-Constrained Optimization

Authors: Weiyu Zhang, Sergiy A. Vorobyov

Abstract: A joint robust transmit/receive adaptive beamforming for multiple-input multipleoutput (MIMO) radar based on probability-constrained optimization approach is developed in the case of Gaussian and arbitrary distributed mismatch present in both the transmit and receive signal steering vectors. A tight lower bound of the probability constraint is also derived by using duality theory. The formulated p… ▽ More A joint robust transmit/receive adaptive beamforming for multiple-input multipleoutput (MIMO) radar based on probability-constrained optimization approach is developed in the case of Gaussian and arbitrary distributed mismatch present in both the transmit and receive signal steering vectors. A tight lower bound of the probability constraint is also derived by using duality theory. The formulated probability-constrained robust beamforming problem is nonconvex and NP-hard. However, we reformulate its cost function into a bi-quadratic function while the probability constraint splits into transmit and receive parts. Then, a block coordinate descent method based on second-order cone programming is developed to address the biconvex problem. Simulation results show an improved robustness of the proposed beamforming method as compared to the worst-case and other existing state-of-the-art joint transmit/receive robust adaptive beamforming methods for MIMO radar. △ Less

Submitted 10 August, 2015; originally announced August 2015.

Comments: 14 pages, 1 figure, Submitted to IEEE Signal Processing Letters on May 2015

Journal ref: IEEE Signal Processing Letters, vol. 23, no. 1, pp. 112-116, Jan. 2016

Ambiguity Function of the Transmit Beamspace-Based MIMO Radar

Authors: Yongzhe Li, Sergiy A. Vorobyov, Visa Koivunen

Abstract: In this paper, we derive an ambiguity function (AF) for the transmit beamspace (TB)-based multipleinput multiple-output (MIMO) radar for the case of far-field targets and narrow-band waveforms. The effects of transmit coherent processing gain and waveform diversity are incorporated into the AF definition. To cover all the phase information conveyed by different factors, we introduce the equivalent… ▽ More In this paper, we derive an ambiguity function (AF) for the transmit beamspace (TB)-based multipleinput multiple-output (MIMO) radar for the case of far-field targets and narrow-band waveforms. The effects of transmit coherent processing gain and waveform diversity are incorporated into the AF definition. To cover all the phase information conveyed by different factors, we introduce the equivalent transmit phase centers. The newly defined AF serves as a generalized AF form for which the phased-array (PA) and traditional MIMO radar AFs are important special cases. We establish relationships among the defined TB-based MIMO radar AF and the existing AF results including the Woodward's AF, the AFs defined for the traditional colocated MIMO radar, and also the PA radar AF, respectively. Moreover, we compare the TB-based MIMO radar AF with the square-summation-form AF definition and identify two limiting cases to bound its 'clear region' in Doppler-delay domain that is free of sidelobes. Corresponding bounds for these two cases are derived, and it is shown that the bound for the worst case is inversely proportional to the number of transmitted waveforms K, whereas the bound for the best case is independent of K. The actual 'clear region' of the TB-based MIMO radar AF depends on the array configuration and is in between of the worst- and best-case bounds. We propose a TB design strategy to reduce the levels of the AF sidelobes, and show in simulations that proper design of the TB matrix leads to reduction of the relative sidelobe levels of the TB-based MIMO radar AF. △ Less

Submitted 23 March, 2015; originally announced March 2015.

Comments: 28 pages, 4 figures, Submitted to IEEE Trans. Signal Processing on July 2014

Journal ref: IEEE Trans. Signal Processing, vol. 63, no. 17, pp.4445-4457, Sept. 2015

Cramer-Rao Bound for Sparse Signals Fitting the Low-Rank Model with Small Number of Parameters

Authors: Mahdi Shaghaghi, Sergiy A. Vorobyov

Abstract: In this paper, we consider signals with a low-rank covariance matrix which reside in a low-dimensional subspace and can be written in terms of a finite (small) number of parameters. Although such signals do not necessarily have a sparse representation in a finite basis, they possess a sparse structure which makes it possible to recover the signal from compressed measurements. We study the statisti… ▽ More In this paper, we consider signals with a low-rank covariance matrix which reside in a low-dimensional subspace and can be written in terms of a finite (small) number of parameters. Although such signals do not necessarily have a sparse representation in a finite basis, they possess a sparse structure which makes it possible to recover the signal from compressed measurements. We study the statistical performance bound for parameter estimation in the low-rank signal model from compressed measurements. Specifically, we derive the Cramer-Rao bound (CRB) for a generic low-rank model and we show that the number of compressed samples needs to be larger than the number of sources for the existence of an unbiased estimator with finite estimation variance. We further consider the applications to direction-of-arrival (DOA) and spectral estimation which fit into the low-rank signal model. We also investigate the effect of compression on the CRB by considering numerical examples of the DOA estimation scenario, and show how the CRB increases by increasing the compression or equivalently reducing the number of compressed samples. △ Less

Submitted 26 February, 2015; originally announced February 2015.

Comments: 14 pages, 1 figure, Submitted to IEEE Signal Processing Letters on December 2014

Journal ref: IEEE Signal Processing Letters, vol. 22, no. 9, pp. 1497-1501, Sept. 2015

Subspace Leakage Analysis and Improved DOA Estimation with Small Sample Size

Authors: Mahdi Shaghaghi, Sergiy A. Vorobyov

Abstract: Classical methods of DOA estimation such as the MUSIC algorithm are based on estimating the signal and noise subspaces from the sample covariance matrix. For a small number of samples, such methods are exposed to performance breakdown, as the sample covariance matrix can largely deviate from the true covariance matrix. In this paper, the problem of DOA estimation performance breakdown is investiga… ▽ More Classical methods of DOA estimation such as the MUSIC algorithm are based on estimating the signal and noise subspaces from the sample covariance matrix. For a small number of samples, such methods are exposed to performance breakdown, as the sample covariance matrix can largely deviate from the true covariance matrix. In this paper, the problem of DOA estimation performance breakdown is investigated. We consider the structure of the sample covariance matrix and the dynamics of the root-MUSIC algorithm. The performance breakdown in the threshold region is associated with the subspace leakage where some portion of the true signal subspace resides in the estimated noise subspace. In this paper, the subspace leakage is theoretically derived. We also propose a two-step method which improves the performance by modifying the sample covariance matrix such that the amount of the subspace leakage is reduced. Furthermore, we introduce a phenomenon named as root-swap which occurs in the root-MUSIC algorithm in the low sample size region and degrades the performance of the DOA estimation. A new method is then proposed to alleviate this problem. Numerical examples and simulation results are given for uncorrelated and correlated sources to illustrate the improvement achieved by the proposed methods. Moreover, the proposed algorithms are combined with the pseudo-noise resampling method to further improve the performance. △ Less

Submitted 31 January, 2015; originally announced February 2015.

Comments: 37 pages, 10 figures, Submitted to the IEEE Transactions on Signal Processing in July 2014

Journal ref: IEEE Trans. Signal Processing, vol. 63, no. 12, pp. 3251-3265, June 2015

Performance Limits of Segmented Compressive Sampling: Correlated Samples versus Bits

Authors: Hao Fang, Sergiy A. Vorobyov, Hai Jiang

Abstract: This paper gives performance limits of the segmented compressive sampling (CS) which collects correlated samples. It is shown that the effect of correlation among samples for the segmented CS can be characterized by a penalty term in the corresponding bounds on the sampling rate. Moreover, this penalty term is vanishing as the signal dimension increases. It means that the performance degradation d… ▽ More This paper gives performance limits of the segmented compressive sampling (CS) which collects correlated samples. It is shown that the effect of correlation among samples for the segmented CS can be characterized by a penalty term in the corresponding bounds on the sampling rate. Moreover, this penalty term is vanishing as the signal dimension increases. It means that the performance degradation due to the fixed correlation among samples obtained by the segmented CS (as compared to the standard CS with equivalent size sampling matrix) is negligible for a high-dimensional signal. In combination with the fact that the signal reconstruction quality improves with additional samples obtained by the segmented CS (as compared to the standard CS with sampling matrix of the size given by the number of original uncorrelated samples), the fact that the additional correlated samples also provide new information about a signal is a strong argument for the segmented CS. △ Less

Submitted 19 November, 2014; originally announced November 2014.

Comments: 27 pages, 8 figures, Submitted to IEEE Trans. Signal Processing on November 2014

Journal ref: IEEE Trans. Signal Processing, vol. 63, no. 22, pp. 6061-6073, Nov. 2015

On the Optimal Precoding for MIMO Gaussian Wire-Tap Channels

Authors: Arash Khabbazibasmenj, Maksym A. Girnyk, Sergiy A. Vorobyov, Mikko Vehkaperä, Lars K. Rasmussen

Abstract: We consider the problem of finding secrecy rate of a multiple-input multiple-output (MIMO) wire-tap channel. A transmitter, a legitimate receiver, and an eavesdropper are all equipped with multiple antennas. The channel states from the transmitter to the legitimate user and to the eavesdropper are assumed to be known at the transmitter. In this contribution, we address the problem of finding the o… ▽ More We consider the problem of finding secrecy rate of a multiple-input multiple-output (MIMO) wire-tap channel. A transmitter, a legitimate receiver, and an eavesdropper are all equipped with multiple antennas. The channel states from the transmitter to the legitimate user and to the eavesdropper are assumed to be known at the transmitter. In this contribution, we address the problem of finding the optimal precoder/transmit covariance matrix maximizing the secrecy rate of the given wiretap channel. The problem formulation is shown to be equivalent to a difference of convex functions programming problem and an efficient algorithm for addressing this problem is developed. △ Less

Submitted 1 November, 2014; originally announced November 2014.

Comments: Published in Proceedings of the Tenth International Symposium on Wireless Communication Systems (ISWCS 2013), Ilmenau, Germany, August 2013

Journal ref: In Proc. 10th Int. Symp. Wireless Commun. Syst. (ISWCS), pp. 1-4, 2013

How Many Beamforming Vectors Generate the Same Beampattern?

Authors: Arash Khabbazibasmenj, Aboulnasr Hassanien, Sergiy A. Vorobyov

Abstract: In this letter, we address the fundamental question of how many beamforming vectors exist which generate the same beampattern? The question is relevant to many fields such as, for example, array processing, radar, wireless communications, data compression, dimensionality reduction, and biomedical engineering. The desired property of having the same beampattern for different columns of a beamspace… ▽ More In this letter, we address the fundamental question of how many beamforming vectors exist which generate the same beampattern? The question is relevant to many fields such as, for example, array processing, radar, wireless communications, data compression, dimensionality reduction, and biomedical engineering. The desired property of having the same beampattern for different columns of a beamspace transformation matrix (beamforming vectors) often plays a key importance in practical applications. The result is that at most 2^{M-1}-1 beamforming vectors with the same beampattern can be generated from any given beamforming vector. Here M is the dimension of the beamforming vector. At the constructive side, the answer to this question allows for computationally efficient techniques for the beamspace transformation design. Indeed, one can start with a single beamforming vector, which gives a desired beampattern, and generate a number of other beamforming vectors, which give absolutely the same beampattern, in a computationally efficient way. We call the initial beamforming vector as the mother beamforming vector. One possible procedure for generating all possible new beamforming vectors with the same beampattern from the mother beamforming vector is proposed. The application of the proposed analysis to the transmit beamspace design in multiple-input multiple-output radar is also given. △ Less

Submitted 7 February, 2014; originally announced February 2014.

Comments: 12 pages, 3 figures, 2 tables, Submitted to the IEEE Signal Processing Letters in February 2014

Journal ref: IEEE Signal Processing Letters, vol. 22, no. 10, pp. 1609-1613, Oct. 2015

Simple Semi-Distributed Lifetime Maximizing Strategy via Power Allocation in Collaborative Beamforming for Wireless Sensor Networks

Authors: Mohammed F. A. Ahmed, Sergiy A. Vorobyov

Abstract: Energy-efficient communication is an important issue in wireless sensor networks (WSNs) consisting of large number of energy-constrained sensor nodes. Indeed, sensor nodes have different energy budgets assigned to data transmission at individual nodes. Therefore, without energy-aware transmission schemes, energy can deplete from sensor nodes with smaller energy budget faster than from the rest of… ▽ More Energy-efficient communication is an important issue in wireless sensor networks (WSNs) consisting of large number of energy-constrained sensor nodes. Indeed, sensor nodes have different energy budgets assigned to data transmission at individual nodes. Therefore, without energy-aware transmission schemes, energy can deplete from sensor nodes with smaller energy budget faster than from the rest of the sensor nodes in WSNs. This reduces the coverage area as well as the lifetime of WSNs. Collaborative beamforming (CB) has been proposed originally to achieve directional gain, however, it also inherently distributes the corresponding energy consumption over the collaborative sensor nodes. In fact, CB can be seen as a physical layer solution (versus the media access control/network layer solution) to balance the lifetimes of individual sensor nodes and extend the lifetime of the whole WSN. However, the introduction of energy-aware CB schemes is critical for extending the WSNs lifetime. In this paper, CB with power allocation (CB-PA) is developed to extend the lifetime of a cluster of collaborative sensor nodes by balancing the individual sensor node lifetimes. A novel strategy is proposed to utilize the residual energy information available at each sensor node. It adjusts the energy consumption rate at each sensor node while achieving the required average signal-to-noise ratio (SNR) at the destination. It is a semi-distributed strategy and it maintains average SNR. Different factors affecting the energy consumption are studied as well. Simulation results show that CB-PA outperforms CB with Equal Power Allocation (CB-EPA) in terms of extending the lifetime of a cluster of collaborative nodes. △ Less

Submitted 16 January, 2014; originally announced January 2014.

Comments: 27 pages, 11 figures, Finished in March 2011, Unpublished

Efficient Strategies for Single/Multi-Target Jamming on MIMO Gaussian Channels

Authors: Jie Gao, Sergiy A. Vorobyov, Hai Jiang

Abstract: The problem of jamming on multiple-input multiple-output (MIMO) Gaussian channels is investigated in this paper. In the case of a single target legitimate signal, we show that the existing result based on the simplification of the system model by neglecting the jamming channel leads to losing important insights regarding the effect of jamming power and jamming channel on the jamming strategy. We f… ▽ More The problem of jamming on multiple-input multiple-output (MIMO) Gaussian channels is investigated in this paper. In the case of a single target legitimate signal, we show that the existing result based on the simplification of the system model by neglecting the jamming channel leads to losing important insights regarding the effect of jamming power and jamming channel on the jamming strategy. We find a closed-form optimal solution for the problem under a positive semi-definite (PSD) condition without considering simplifications in the model. If the condition is not satisfied and the optimal solution may not exist in closed-form, we find the optimal solution using a numerical method and also propose a suboptimal solution in closed-form as a close approximation of the optimal solution. Then, the possibility of extending the results to solve the problem of multi-target jamming is investigated for four scenarios, i.e., multiple access channel, broadcasting channel, multiple transceiver pairs with orthogonal transmissions, and multiple transceiver pairs with interference, respectively. It is shown that the proposed numerical method can be extended to all scenarios while the proposed closed-form solutions for jamming may be applied in the scenarios of the multiple access channel and multiple transceiver pairs with orthogonal transmissions. Simulation results verify the effectiveness of the proposed solutions. △ Less

Submitted 15 January, 2014; originally announced January 2014.

Comments: 24 pages, 5 figures, Submitted to IEEE Trans. Signal Processing on December 2013

Journal ref: IEEE Trans. Signal Processing, vol. 63, no. 21, pp. 5821-5836, Nov. 2015