Showing 1–13 of 13 results for author: Khobahi, S

One-Bit Compressive Sensing: Can We Go Deep and Blind?

Authors: Yiming Zeng, Shahin Khobahi, Mojtaba Soltanalian

Abstract: One-bit compressive sensing is concerned with the accurate recovery of an underlying sparse signal of interest from its one-bit noisy measurements. The conventional signal recovery approaches for this problem are mainly developed based on the assumption that an exact knowledge of the sensing matrix is available. In this work, however, we present a novel data-driven and model-based methodology that… ▽ More One-bit compressive sensing is concerned with the accurate recovery of an underlying sparse signal of interest from its one-bit noisy measurements. The conventional signal recovery approaches for this problem are mainly developed based on the assumption that an exact knowledge of the sensing matrix is available. In this work, however, we present a novel data-driven and model-based methodology that achieves blind recovery; i.e., signal recovery without requiring the knowledge of the sensing matrix. To this end, we make use of the deep unfolding technique and develop a model-driven deep neural architecture which is designed for this specific task. The proposed deep architecture is able to learn an alternative sensing matrix by taking advantage of the underlying unfolded algorithm such that the resulting learned recovery algorithm can accurately and quickly (in terms of the number of iterations) recover the underlying compressed signal of interest from its one-bit noisy measurements. In addition, due to the incorporation of the domain knowledge and the mathematical model of the system into the proposed deep architecture, the resulting network benefits from enhanced interpretability, has a very small number of trainable parameters, and requires very small number of training samples, as compared to the commonly used black-box deep neural network alternatives for the problem at hand. △ Less

Submitted 21 September, 2022; v1 submitted 13 March, 2022; originally announced March 2022.

Comments: IEEE SIGNAL PROCESSING LETTERS,2022

Journal ref: IEEE Signal Processing Letters, vol. 29, pp. 1629-1633, 2022

LoRD-Net: Unfolded Deep Detection Network with Low-Resolution Receivers

Authors: Shahin Khobahi, Nir Shlezinger, Mojtaba Soltanalian, Yonina C. Eldar

Abstract: The need to recover high-dimensional signals from their noisy low-resolution quantized measurements is widely encountered in communications and sensing. In this paper, we focus on the extreme case of one-bit quantizers, and propose a deep detector entitled LoRD-Net for recovering information symbols from one-bit measurements. Our method is a model-aware data-driven architecture based on deep unfol… ▽ More The need to recover high-dimensional signals from their noisy low-resolution quantized measurements is widely encountered in communications and sensing. In this paper, we focus on the extreme case of one-bit quantizers, and propose a deep detector entitled LoRD-Net for recovering information symbols from one-bit measurements. Our method is a model-aware data-driven architecture based on deep unfolding of first-order optimization iterations. LoRD-Net has a task-based architecture dedicated to recovering the underlying signal of interest from the one-bit noisy measurements without requiring prior knowledge of the channel matrix through which the one-bit measurements are obtained. The proposed deep detector has much fewer parameters compared to black-box deep networks due to the incorporation of domain-knowledge in the design of its architecture, allowing it to operate in a data-driven fashion while benefiting from the flexibility, versatility, and reliability of model-based optimization methods. LoRD-Net operates in a blind fashion, which requires addressing both the non-linear nature of the data-acquisition system as well as identifying a proper optimization objective for signal recovery. Accordingly, we propose a two-stage training method for LoRD-Net, in which the first stage is dedicated to identifying the proper form of the optimization process to unfold, while the latter trains the resulting model in an end-to-end manner. We numerically evaluate the proposed receiver architecture for one-bit signal recovery in wireless communications and demonstrate that the proposed hybrid methodology outperforms both data-driven and model-based state-of-the-art methods, while utilizing small datasets, on the order of merely $\sim 500$ samples, for training. △ Less

Submitted 4 February, 2021; originally announced February 2021.

Deep-RLS: A Model-Inspired Deep Learning Approach to Nonlinear PCA

Authors: Zahra Esmaeilbeig, Shahin Khobahi, Mojtaba Soltanalian

Abstract: In this work, we consider the application of model-based deep learning in nonlinear principal component analysis (PCA). Inspired by the deep unfolding methodology, we propose a task-based deep learning approach, referred to as Deep-RLS, that unfolds the iterations of the well-known recursive least squares (RLS) algorithm into the layers of a deep neural network in order to perform nonlinear PCA. I… ▽ More In this work, we consider the application of model-based deep learning in nonlinear principal component analysis (PCA). Inspired by the deep unfolding methodology, we propose a task-based deep learning approach, referred to as Deep-RLS, that unfolds the iterations of the well-known recursive least squares (RLS) algorithm into the layers of a deep neural network in order to perform nonlinear PCA. In particular, we formulate the nonlinear PCA for the blind source separation (BSS) problem and show through numerical analysis that Deep-RLS results in a significant improvement in the accuracy of recovering the source signals in BSS when compared to the traditional RLS algorithm. △ Less

Submitted 17 November, 2020; v1 submitted 15 November, 2020; originally announced November 2020.

UPR: A Model-Driven Architecture for Deep Phase Retrieval

Authors: Naveed Naimipour, Shahin Khobahi, Mojtaba Soltanalian

Abstract: The problem of phase retrieval has been intriguing researchers for decades due to its appearance in a wide range of applications. The task of a phase retrieval algorithm is typically to recover a signal from linear phase-less measurements. In this paper, we approach the problem by proposing a hybrid model-based data-driven deep architecture, referred to as the Unfolded Phase Retrieval (UPR), that… ▽ More The problem of phase retrieval has been intriguing researchers for decades due to its appearance in a wide range of applications. The task of a phase retrieval algorithm is typically to recover a signal from linear phase-less measurements. In this paper, we approach the problem by proposing a hybrid model-based data-driven deep architecture, referred to as the Unfolded Phase Retrieval (UPR), that shows potential in improving the performance of the state-of-the-art phase retrieval algorithms. Specifically, the proposed method benefits from versatility and interpretability of well established model-based algorithms, while simultaneously benefiting from the expressive power of deep neural networks. Our numerical results illustrate the effectiveness of such hybrid deep architectures and showcase the untapped potential of data-aided methodologies to enhance the existing phase retrieval algorithms. △ Less

Submitted 9 March, 2020; originally announced March 2020.

Efficient Waveform Covariance Matrix Design and Antenna Selection for MIMO Radar

Authors: Arindam Bose, Shahin Khobahi, Mojtaba Soltanalian

Abstract: Controlling the radar beam-pattern by optimizing the transmit covariance matrix is a well-established approach for performance enhancement in multiple-input-multiple-output (MIMO) radars. In this paper, we investigate the joint optimization of the waveform covariance matrix and the antenna position vector for a MIMO radar system to approximate a given transmit beam-pattern, as well as to minimize… ▽ More Controlling the radar beam-pattern by optimizing the transmit covariance matrix is a well-established approach for performance enhancement in multiple-input-multiple-output (MIMO) radars. In this paper, we investigate the joint optimization of the waveform covariance matrix and the antenna position vector for a MIMO radar system to approximate a given transmit beam-pattern, as well as to minimize the cross-correlation between the probing signals at a number of given target locations. We formulate this design task as a non-convex optimization problem and then propose a cyclic optimization approach to efficiently approximate its solution. We further propose a local binary search algorithm in order to efficiently design the corresponding antenna positions. We show that the proposed method can be extended to the more general case of approximating the given beam-pattern using a minimal number of antennas as well as optimizing their positions. Our numerical investigations demonstrate a great performance both in terms of accuracy and computational complexity, making the proposed framework a good candidate for usage in real-time radar waveform processing applications such as MIMO radar transmit beamforming for aerial drones that are in motion. △ Less

Submitted 24 December, 2020; v1 submitted 12 February, 2020; originally announced February 2020.

Comments: arXiv admin note: text overlap with arXiv:1910.07591

Deep Radar Waveform Design for Efficient Automotive Radar Sensing

Authors: Shahin Khobahi, Arindam Bose, Mojtaba Soltanalian

Abstract: In radar systems, unimodular (or constant-modulus) waveform design plays an important role in achieving better clutter/interference rejection, as well as a more accurate estimation of the target parameters. The design of such sequences has been studied widely in the last few decades, with most design algorithms requiring sophisticated a priori knowledge of environmental parameters which may be dif… ▽ More In radar systems, unimodular (or constant-modulus) waveform design plays an important role in achieving better clutter/interference rejection, as well as a more accurate estimation of the target parameters. The design of such sequences has been studied widely in the last few decades, with most design algorithms requiring sophisticated a priori knowledge of environmental parameters which may be difficult to obtain in real-time scenarios. In this paper, we propose a novel hybrid model-driven and data-driven architecture that adapts to the ever changing environment and allows for adaptive unimodular waveform design. In particular, the approach lays the groundwork for develo** extremely low-cost waveform design and processing frameworks for radar systems deployed in autonomous vehicles. The proposed model-based deep architecture imitates a well-known unimodular signal design algorithm in its structure, and can quickly infer statistical information from the environment using the observed data. Our numerical experiments portray the advantages of using the proposed method for efficient radar waveform design in time-varying environments. △ Less

Submitted 19 December, 2019; v1 submitted 17 December, 2019; originally announced December 2019.

Deep One-bit Compressive Autoencoding

Authors: Shahin Khobahi, Arindam Bose, Mojtaba Soltanalian

Abstract: Parameterized mathematical models play a central role in understanding and design of complex information systems. However, they often cannot take into account the intricate interactions innate to such systems. On the contrary, purely data-driven approaches do not need explicit mathematical models for data generation and have a wider applicability at the cost of interpretability. In this paper, we… ▽ More Parameterized mathematical models play a central role in understanding and design of complex information systems. However, they often cannot take into account the intricate interactions innate to such systems. On the contrary, purely data-driven approaches do not need explicit mathematical models for data generation and have a wider applicability at the cost of interpretability. In this paper, we consider the design of a one-bit compressive autoencoder, and propose a novel hybrid model-based and data-driven methodology that allows us to not only design the sensing matrix for one-bit data acquisition, but also allows for learning the latent-parameters of an iterative optimization algorithm specifically designed for the problem of one-bit sparse signal recovery. Our results demonstrate a significant improvement compared to state-of-the-art model-based algorithms. △ Less

Submitted 10 December, 2019; originally announced December 2019.

Comments: This work have been submitted to the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Barcelona, Spain, May 2020. arXiv admin note: substantial text overlap with arXiv:1911.12410

Model-Aware Deep Architectures for One-Bit Compressive Variational Autoencoding

Authors: Shahin Khobahi, Mojtaba Soltanalian

Abstract: Parameterized mathematical models play a central role in understanding and design of complex information systems. However, they often cannot take into account the intricate interactions innate to such systems. On the contrary, purely data-driven approaches do not need explicit mathematical models for data generation and have a wider applicability at the cost of interpretability. In this paper, we… ▽ More Parameterized mathematical models play a central role in understanding and design of complex information systems. However, they often cannot take into account the intricate interactions innate to such systems. On the contrary, purely data-driven approaches do not need explicit mathematical models for data generation and have a wider applicability at the cost of interpretability. In this paper, we consider the design of a one-bit compressive variational autoencoder, and propose a novel hybrid model-based and data-driven methodology that allows us not only to design the sensing matrix and the quantization thresholds for one-bit data acquisition, but also allows for learning the latent-parameters of iterative optimization algorithms specifically designed for the problem of one-bit sparse signal recovery. In addition, the proposed method has the ability to adaptively learn the proper quantization thresholds, paving the way for amplitude recovery in one-bit compressive sensing. Our results demonstrate a significant improvement compared to state-of-the-art model-based algorithms. △ Less

Submitted 27 November, 2019; originally announced November 2019.

Joint Optimization of Waveform Covariance Matrix and Antenna Selection for MIMO Radar

Authors: Arindam Bose, Shahin Khobahi, Mojtaba Soltanalian

Abstract: In this paper, we investigate the problem of jointly optimizing the waveform covariance matrix and the antenna position vector for multiple-input-multiple-output (MIMO) radar systems to approximate a desired transmit beampattern as well as to minimize the cross-correlation of the received signals reflected back from the targets. We formulate the problem as a non-convex program and then propose a c… ▽ More In this paper, we investigate the problem of jointly optimizing the waveform covariance matrix and the antenna position vector for multiple-input-multiple-output (MIMO) radar systems to approximate a desired transmit beampattern as well as to minimize the cross-correlation of the received signals reflected back from the targets. We formulate the problem as a non-convex program and then propose a cyclic optimization approach to efficiently tackle the problem. We further propose a novel local optimization framework in order to efficiently design the corresponding antenna positions. Our numerical investigations demonstrate a good performance both in terms of accuracy and computational complexity, making the proposed framework a good candidate for real-time radar signal processing applications. △ Less

Submitted 1 December, 2019; v1 submitted 16 October, 2019; originally announced October 2019.

Comments: This paper is accepted for publication in the 2019 IEEE Asilomar Conference on Signals, Systems, and Computers (Asilomar 2019)

Optimized Transmission for Parameter Estimation in Wireless Sensor Networks

Authors: Shahin Khobahi, Mojtaba Soltanalian, Feng Jiang, A. Lee Swindlehurst

Abstract: A central problem in analog wireless sensor networks is to design the gain or phase-shifts of the sensor nodes (i.e. the relaying configuration) in order to achieve an accurate estimation of some parameter of interest at a fusion center, or more generally, at each node by employing a distributed parameter estimation scheme. In this paper, by using an over-parametrization of the original design pro… ▽ More A central problem in analog wireless sensor networks is to design the gain or phase-shifts of the sensor nodes (i.e. the relaying configuration) in order to achieve an accurate estimation of some parameter of interest at a fusion center, or more generally, at each node by employing a distributed parameter estimation scheme. In this paper, by using an over-parametrization of the original design problem, we devise a cyclic optimization approach that can handle tuning both gains and phase-shifts of the sensor nodes, even in intricate scenarios involving sensor selection or discrete phase-shifts. Each iteration of the proposed design framework consists of a combination of the Gram-Schmidt process and power method-like iterations, and as a result, enjoys a low computational cost. Along with formulating the design problem for a fusion center, we further present a consensus-based framework for decentralized estimation of deterministic parameters in a distributed network, which results in a similar sensor gain design problem. The numerical results confirm the computational advantage of the suggested approach in comparison with the state-of-the-art methods---an advantage that becomes more pronounced when the sensor network grows large. △ Less

Submitted 1 August, 2019; originally announced August 2019.

Comments: Accepted for publication in IEEE Transactions on Signal and Information Processing over Networks

Signal Recovery From 1-Bit Quantized Noisy Samples via Adaptive Thresholding

Authors: Shahin Khobahi, Mojtaba Soltanalian

Abstract: In this paper, we consider the problem of signal recovery from 1-bit noisy measurements. We present an efficient method to obtain an estimation of the signal of interest when the measurements are corrupted by white or colored noise. To the best of our knowledge, the proposed framework is the pioneer effort in the area of 1-bit sampling and signal recovery in providing a unified framework to deal w… ▽ More In this paper, we consider the problem of signal recovery from 1-bit noisy measurements. We present an efficient method to obtain an estimation of the signal of interest when the measurements are corrupted by white or colored noise. To the best of our knowledge, the proposed framework is the pioneer effort in the area of 1-bit sampling and signal recovery in providing a unified framework to deal with the presence of noise with an arbitrary covariance matrix including that of the colored noise. The proposed method is based on a constrained quadratic program (CQP) formulation utilizing an adaptive quantization thresholding approach, that further enables us to accurately recover the signal of interest from its 1-bit noisy measurements. In addition, due to the adaptive nature of the proposed method, it can recover both fixed and time-varying parameters from their quantized 1-bit samples. △ Less

Submitted 10 December, 2018; originally announced December 2018.

Comments: This is a pre-print version of the original conference paper that has been accepted at the 2018 IEEE Asilomar Conference on Signals, Systems, and Computers

Deep Signal Recovery with One-Bit Quantization

Authors: Shahin Khobahi, Naveed Naimipour, Mojtaba Soltanalian, Yonina C. Eldar

Abstract: Machine learning, and more specifically deep learning, have shown remarkable performance in sensing, communications, and inference. In this paper, we consider the application of the deep unfolding technique in the problem of signal reconstruction from its one-bit noisy measurements. Namely, we propose a model-based machine learning method and unfold the iterations of an inference optimization algo… ▽ More Machine learning, and more specifically deep learning, have shown remarkable performance in sensing, communications, and inference. In this paper, we consider the application of the deep unfolding technique in the problem of signal reconstruction from its one-bit noisy measurements. Namely, we propose a model-based machine learning method and unfold the iterations of an inference optimization algorithm into the layers of a deep neural network for one-bit signal recovery. The resulting network, which we refer to as DeepRec, can efficiently handle the recovery of high-dimensional signals from acquired one-bit noisy measurements. The proposed method results in an improvement in accuracy and computational efficiency with respect to the original framework as shown through numerical analysis. △ Less

Submitted 29 November, 2018; originally announced December 2018.

Comments: This paper has been submitted to the 44th International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2019)

Optimized Transmission for Consensus in Wireless Sensor Networks

Authors: Shahin Khobahi, Mojtaba Soltanalian

Abstract: In this paper, we present a consensus-based framework for decentralized estimation of deterministic parameters in wireless sensor networks (WSNs). In particular, we propose an optimization algorithm to design (possibly complex) sensor gains in order to achieve an estimate of the parameter of interest that is as accurate as possible. The proposed design algorithm employs a cyclic approach capable o… ▽ More In this paper, we present a consensus-based framework for decentralized estimation of deterministic parameters in wireless sensor networks (WSNs). In particular, we propose an optimization algorithm to design (possibly complex) sensor gains in order to achieve an estimate of the parameter of interest that is as accurate as possible. The proposed design algorithm employs a cyclic approach capable of handling various sensor gain constraints. In addition, each iteration of the proposed design framework is comprised of the Gram-Schmidt process and power-method like iterations, and as a result, enjoys a low-computational cost. △ Less

Submitted 30 July, 2018; originally announced July 2018.

Comments: In Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2018, 15-20 April 2018, Alberta, Canada

Journal ref: 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)