-
Multi-Agent Active Search using Realistic Depth-Aware Noise Model
Authors:
Ramina Ghods,
William J. Durkin,
Jeff Schneider
Abstract:
The active search for objects of interest in an unknown environment has many robotics applications including search and rescue, detecting gas leaks or locating animal poachers. Existing algorithms often prioritize the location accuracy of objects of interest while other practical issues such as the reliability of object detection as a function of distance and lines of sight remain largely ignored.…
▽ More
The active search for objects of interest in an unknown environment has many robotics applications including search and rescue, detecting gas leaks or locating animal poachers. Existing algorithms often prioritize the location accuracy of objects of interest while other practical issues such as the reliability of object detection as a function of distance and lines of sight remain largely ignored. Additionally, in many active search scenarios, communication infrastructure may be unreliable or unestablished, making centralized control of multiple agents impractical. We present an algorithm called Noise-Aware Thompson Sampling (NATS) that addresses these issues for multiple ground-based robots performing active search considering two sources of sensory information from monocular optical imagery and depth maps. By utilizing Thompson Sampling, NATS allows for decentralized coordination among multiple agents. NATS also considers object detection uncertainty from depth as well as environmental occlusions and operates while remaining agnostic of the number of objects of interest. Using simulation results, we show that NATS significantly outperforms existing methods such as information-greedy policies or exhaustive search. We demonstrate the real-world viability of NATS using a pseudo-realistic environment created in the Unreal Engine 4 game development platform with the AirSim plugin.
△ Less
Submitted 22 March, 2021; v1 submitted 9 November, 2020;
originally announced November 2020.
-
Optimal Data Detection and Signal Estimation in Systems with Input Noise
Authors:
Ramina Ghods,
Charles Jeon,
Arian Maleki,
Christoph Studer
Abstract:
Practical systems often suffer from hardware impairments that already appear during signal generation. Despite the limiting effect of such input-noise impairments on signal processing systems, they are routinely ignored in the literature. In this paper, we propose an algorithm for data detection and signal estimation, referred to as Approximate Message Passing with Input noise (AMPI), which takes…
▽ More
Practical systems often suffer from hardware impairments that already appear during signal generation. Despite the limiting effect of such input-noise impairments on signal processing systems, they are routinely ignored in the literature. In this paper, we propose an algorithm for data detection and signal estimation, referred to as Approximate Message Passing with Input noise (AMPI), which takes into account input-noise impairments. To demonstrate the efficacy of AMPI, we investigate two applications: Data detection in large multiple-input multiple output (MIMO) wireless systems and sparse signal recovery in compressive sensing. For both applications, we provide precise conditions in the large-system limit for which AMPI achieves optimal performance. We furthermore use simulations to demonstrate that AMPI achieves near-optimal performance at low complexity in realistic, finite-dimensional systems.
△ Less
Submitted 5 August, 2020;
originally announced August 2020.
-
Asynchronous Multi Agent Active Search
Authors:
Ramina Ghods,
Arundhati Banerjee,
Jeff Schneider
Abstract:
Active search refers to the problem of efficiently locating targets in an unknown environment by actively making data-collection decisions, and has many applications including detecting gas leaks, radiation sources or human survivors of disasters using aerial and/or ground robots (agents). Existing active search methods are in general only amenable to a single agent, or if they extend to multi age…
▽ More
Active search refers to the problem of efficiently locating targets in an unknown environment by actively making data-collection decisions, and has many applications including detecting gas leaks, radiation sources or human survivors of disasters using aerial and/or ground robots (agents). Existing active search methods are in general only amenable to a single agent, or if they extend to multi agent they require a central control system to coordinate the actions of all agents. However, such control systems are often impractical in robotics applications. In this paper, we propose two distinct active search algorithms called SPATS (Sparse Parallel Asynchronous Thompson Sampling) and LATSI (LAplace Thompson Sampling with Information gain) that allow for multiple agents to independently make data-collection decisions without a central coordinator. Throughout we consider that targets are sparsely located around the environment in kee** with compressive sensing assumptions and its applicability in real world scenarios. Additionally, while most common search algorithms assume that agents can sense the entire environment (e.g. compressive sensing) or sense point-wise (e.g. Bayesian Optimization) at all times, we make a realistic assumption that each agent can only sense a contiguous region of space at a time. We provide simulation results as well as theoretical analysis to demonstrate the efficacy of our proposed algorithms.
△ Less
Submitted 25 June, 2020;
originally announced June 2020.
-
Sparsity-Adaptive Beamspace Channel Estimation for 1-Bit mmWave Massive MIMO Systems
Authors:
Alexandra Gallyas-Sanhueza,
Seyed Hadi Mirfarshbafan,
Ramina Ghods,
Christoph Studer
Abstract:
We propose sparsity-adaptive beamspace channel estimation algorithms that improve accuracy for 1-bit data converters in all-digital millimeter-wave (mmWave) massive multiple-input multiple-output (MIMO) basestations. Our algorithms include a tuning stage based on Stein's unbiased risk estimate (SURE) that automatically selects optimal denoising parameters depending on the instantaneous channel con…
▽ More
We propose sparsity-adaptive beamspace channel estimation algorithms that improve accuracy for 1-bit data converters in all-digital millimeter-wave (mmWave) massive multiple-input multiple-output (MIMO) basestations. Our algorithms include a tuning stage based on Stein's unbiased risk estimate (SURE) that automatically selects optimal denoising parameters depending on the instantaneous channel conditions. Simulation results with line-of-sight (LoS) and non-LoS mmWave massive MIMO channel models show that our algorithms improve channel estimation accuracy with 1-bit measurements in a computationally-efficient manner.
△ Less
Submitted 30 May, 2020;
originally announced June 2020.
-
MSE-Optimal Neural Network Initialization via Layer Fusion
Authors:
Ramina Ghods,
Andrew S. Lan,
Tom Goldstein,
Christoph Studer
Abstract:
Deep neural networks achieve state-of-the-art performance for a range of classification and inference tasks. However, the use of stochastic gradient descent combined with the nonconvexity of the underlying optimization problems renders parameter learning susceptible to initialization. To address this issue, a variety of methods that rely on random parameter initialization or knowledge distillation…
▽ More
Deep neural networks achieve state-of-the-art performance for a range of classification and inference tasks. However, the use of stochastic gradient descent combined with the nonconvexity of the underlying optimization problems renders parameter learning susceptible to initialization. To address this issue, a variety of methods that rely on random parameter initialization or knowledge distillation have been proposed in the past. In this paper, we propose FuseInit, a novel method to initialize shallower networks by fusing neighboring layers of deeper networks that are trained with random initialization. We develop theoretical results and efficient algorithms for mean-square error (MSE)-optimal fusion of neighboring dense-dense, convolutional-dense, and convolutional-convolutional layers. We show experiments for a range of classification and regression datasets, which suggest that deeper neural networks are less sensitive to initialization and shallower networks can perform better (sometimes as well as their deeper counterparts) if initialized with FuseInit.
△ Less
Submitted 28 January, 2020;
originally announced January 2020.
-
Reducing the Complexity of Fingerprinting-Based Positioning using Locality-Sensitive Hashing
Authors:
Larry Tang,
Ramina Ghods,
Christoph Studer
Abstract:
Localization of wireless transmitters based on channel state information (CSI) fingerprinting finds widespread use in indoor as well as outdoor scenarios. Fingerprinting localization first builds a database containing CSI with measured location information. One then searches for the most similar CSI in this database to approximate the position of wireless transmitters. In this paper, we investigat…
▽ More
Localization of wireless transmitters based on channel state information (CSI) fingerprinting finds widespread use in indoor as well as outdoor scenarios. Fingerprinting localization first builds a database containing CSI with measured location information. One then searches for the most similar CSI in this database to approximate the position of wireless transmitters. In this paper, we investigate the efficacy of locality-sensitive hashing (LSH) to reduce the complexity of the nearest neighbor-search (NNS) required by conventional fingerprinting localization systems. More specifically, we propose a low-complexity and memory efficient LSH function based on the sum-to-one (STOne) transform and use approximate hash matches. We evaluate the accuracy and complexity (in terms of the number of searches and storage requirements) of our approach for line-of-sight (LoS) and non-LoS channels, and we show that LSH enables low-complexity fingerprinting localization with comparable accuracy to methods relying on exact NNS or deep neural networks.
△ Less
Submitted 2 December, 2019;
originally announced December 2019.
-
Beamspace Channel Estimation for Massive MIMO mmWave Systems: Algorithm and VLSI Design
Authors:
Seyed Hadi Mirfarshbafan,
Alexandra Gallyas-Sanhueza,
Ramina Ghods,
Christoph Studer
Abstract:
Millimeter-wave (mmWave) communication in combination with massive multiuser multiple-input multiple-output (MU-MIMO) enables high-bandwidth data transmission to multiple users in the same time-frequency resource. The strong path loss of wave propagation at such high frequencies necessitates accurate channel state information to ensure reliable data transmission. We propose a novel channel estimat…
▽ More
Millimeter-wave (mmWave) communication in combination with massive multiuser multiple-input multiple-output (MU-MIMO) enables high-bandwidth data transmission to multiple users in the same time-frequency resource. The strong path loss of wave propagation at such high frequencies necessitates accurate channel state information to ensure reliable data transmission. We propose a novel channel estimation algorithm called BEAmspace CHannel EStimation (BEACHES), which leverages the fact that wave propagation at mmWave frequencies is predominantly directional. BEACHES adaptively denoises the channel vectors in the beamspace domain using an adaptive shrinkage procedure that relies on Stein's unbiased risk estimator (SURE). Simulation results for line-of-sight (LoS) and non-LoS mmWave channels reveal that BEACHES performs on par with state-of-the-art channel estimation methods while requiring orders-of-magnitude lower complexity. To demonstrate the effectiveness of BEACHES in practice, we develop a very large-scale integration (VLSI) architecture and provide field-programmable gate array (FPGA) implementation results. Our results show that adaptive channel denoising can be performed at high throughput and in a hardware-friendly manner for massive MU-MIMO mmWave systems with hundreds of antennas.
△ Less
Submitted 6 September, 2020; v1 submitted 1 October, 2019;
originally announced October 2019.
-
BEACHES: Beamspace Channel Estimation for Multi-Antenna mmWave Systems and Beyond
Authors:
Ramina Ghods,
Alexandra Gallyas-Sanhueza,
Seyed Hadi Mirfarshbafan,
Christoph Studer
Abstract:
Massive multi-antenna millimeter wave (mmWave) and terahertz wireless systems promise high-bandwidth communication to multiple user equipments in the same time-frequency resource. The high path loss of wave propagation at such frequencies and the fine-grained nature of beamforming with massive antenna arrays necessitates accurate channel estimation to fully exploit the advantages of such systems.…
▽ More
Massive multi-antenna millimeter wave (mmWave) and terahertz wireless systems promise high-bandwidth communication to multiple user equipments in the same time-frequency resource. The high path loss of wave propagation at such frequencies and the fine-grained nature of beamforming with massive antenna arrays necessitates accurate channel estimation to fully exploit the advantages of such systems. In this paper, we propose BEAmspace CHannel EStimation (BEACHES), a low-complexity channel estimation algorithm for multi-antenna mmWave systems and beyond. BEACHES leverages the fact that wave propagation at high frequencies is directional, which enables us to denoise the (approximately) sparse channel state information in the beamspace domain. To avoid tedious parameter selection, BEACHES includes a computationally-efficient tuning stage that provably minimizes the mean-square error of the channel estimate in the large-antenna limit. To demonstrate the efficacy of BEACHES, we provide simulation results for line-of-sight (LoS) and non-LoS mmWave channel models.
△ Less
Submitted 7 August, 2019;
originally announced August 2019.
-
Optimal Data Detection in Large MIMO
Authors:
Charles Jeon,
Ramina Ghods,
Arian Maleki,
Christoph Studer
Abstract:
Large multiple-input multiple-output (MIMO) appears in massive multi-user MIMO and randomly-spread code-division multiple access (CDMA)-based wireless systems. In order to cope with the excessively high complexity of optimal data detection in such systems, a variety of efficient yet sub-optimal algorithms have been proposed in the past. In this paper, we propose a data detection algorithm that is…
▽ More
Large multiple-input multiple-output (MIMO) appears in massive multi-user MIMO and randomly-spread code-division multiple access (CDMA)-based wireless systems. In order to cope with the excessively high complexity of optimal data detection in such systems, a variety of efficient yet sub-optimal algorithms have been proposed in the past. In this paper, we propose a data detection algorithm that is computationally efficient and optimal in a sense that it is able to achieve the same error-rate performance as the individually optimal (IO) data detector under certain assumptions on the MIMO system matrix and constellation alphabet. Our algorithm, which we refer to as LAMA (short for large MIMO AMP), builds on complex-valued Bayesian approximate message passing (AMP), which enables an exact analytical characterization of the performance and complexity in the large-system limit via the state-evolution framework. We derive optimality conditions for LAMA and investigate performance/complexity trade-offs. As a byproduct of our analysis, we recover classical results of IO data detection for randomly-spread CDMA. We furthermore provide practical ways for LAMA to approach the theoretical performance limits in realistic, finite-dimensional systems at low computational complexity.
△ Less
Submitted 5 November, 2018;
originally announced November 2018.
-
Linear Spectral Estimators and an Application to Phase Retrieval
Authors:
Ramina Ghods,
Andrew S. Lan,
Tom Goldstein,
Christoph Studer
Abstract:
Phase retrieval refers to the problem of recovering real- or complex-valued vectors from magnitude measurements. The best-known algorithms for this problem are iterative in nature and rely on so-called spectral initializers that provide accurate initialization vectors. We propose a novel class of estimators suitable for general nonlinear measurement systems, called linear spectral estimators (LSPE…
▽ More
Phase retrieval refers to the problem of recovering real- or complex-valued vectors from magnitude measurements. The best-known algorithms for this problem are iterative in nature and rely on so-called spectral initializers that provide accurate initialization vectors. We propose a novel class of estimators suitable for general nonlinear measurement systems, called linear spectral estimators (LSPEs), which can be used to compute accurate initialization vectors for phase retrieval problems. The proposed LSPEs not only provide accurate initialization vectors for noisy phase retrieval systems with structured or random measurement matrices, but also enable the derivation of sharp and nonasymptotic mean-squared error bounds. We demonstrate the efficacy of LSPEs on synthetic and real-world phase retrieval problems, and show that our estimators significantly outperform existing methods for structured measurement systems that arise in practice.
△ Less
Submitted 9 June, 2018;
originally announced June 2018.
-
PhaseLin: Linear Phase Retrieval
Authors:
Ramina Ghods,
Andrew S. Lan,
Tom Goldstein,
Christoph Studer
Abstract:
Phase retrieval deals with the recovery of complex- or real-valued signals from magnitude measurements. As shown recently, the method PhaseMax enables phase retrieval via convex optimization and without lifting the problem to a higher dimension. To succeed, PhaseMax requires an initial guess of the solution, which can be calculated via spectral initializers. In this paper, we show that with the av…
▽ More
Phase retrieval deals with the recovery of complex- or real-valued signals from magnitude measurements. As shown recently, the method PhaseMax enables phase retrieval via convex optimization and without lifting the problem to a higher dimension. To succeed, PhaseMax requires an initial guess of the solution, which can be calculated via spectral initializers. In this paper, we show that with the availability of an initial guess, phase retrieval can be carried out with an ever simpler, linear procedure. Our algorithm, called PhaseLin, is the linear estimator that minimizes the mean squared error (MSE) when applied to the magnitude measurements. The linear nature of PhaseLin enables an exact and nonasymptotic MSE analysis for arbitrary measurement matrices. We furthermore demonstrate that by iteratively using PhaseLin, one arrives at an efficient phase retrieval algorithm that performs on par with existing convex and nonconvex methods on synthetic and real-world data.
△ Less
Submitted 1 February, 2018;
originally announced February 2018.
-
Optimally-Tuned Nonparametric Linear Equalization for Massive MU-MIMO Systems
Authors:
Ramina Ghods,
Charles Jeon,
Gulnar Mirza,
Arian Maleki,
Christoph Studer
Abstract:
This paper deals with linear equalization in massive multi-user multiple-input multiple-output (MU-MIMO) wireless systems. We first provide simple conditions on the antenna configuration for which the well-known linear minimum mean-square error (L-MMSE) equalizer provides near-optimal spectral efficiency, and we analyze its performance in the presence of parameter mismatches in the signal and/or n…
▽ More
This paper deals with linear equalization in massive multi-user multiple-input multiple-output (MU-MIMO) wireless systems. We first provide simple conditions on the antenna configuration for which the well-known linear minimum mean-square error (L-MMSE) equalizer provides near-optimal spectral efficiency, and we analyze its performance in the presence of parameter mismatches in the signal and/or noise powers. We then propose a novel, optimally-tuned NOnParametric Equalizer (NOPE) for massive MU-MIMO systems, which avoids knowledge of the transmit signal and noise powers altogether. We show that NOPE achieves the same performance as that of the L-MMSE equalizer in the large-antenna limit, and we demonstrate its efficacy in realistic, finite-dimensional systems. From a practical perspective, NOPE is computationally efficient and avoids dedicated training that is typically required for parameter estimation
△ Less
Submitted 8 May, 2017;
originally announced May 2017.