-
Emerging Approaches for THz Array Imaging: A Tutorial Review and Software Tool
Authors:
Josiah W. Smith,
Murat Torlak
Abstract:
Accelerated by the increasing attention drawn by 5G, 6G, and Internet of Things applications, communication and sensing technologies have rapidly evolved from millimeter-wave (mmWave) to terahertz (THz) in recent years. Enabled by significant advancements in electromagnetic (EM) hardware, mmWave and THz frequency regimes spanning 30 GHz to 300 GHz and 300 GHz to 3000 GHz, respectively, can be empl…
▽ More
Accelerated by the increasing attention drawn by 5G, 6G, and Internet of Things applications, communication and sensing technologies have rapidly evolved from millimeter-wave (mmWave) to terahertz (THz) in recent years. Enabled by significant advancements in electromagnetic (EM) hardware, mmWave and THz frequency regimes spanning 30 GHz to 300 GHz and 300 GHz to 3000 GHz, respectively, can be employed for a host of applications. The main feature of THz systems is high-bandwidth transmission, enabling ultra-high-resolution imaging and high-throughput communications; however, challenges in both the hardware and algorithmic arenas remain for the ubiquitous adoption of THz technology. Spectra comprising mmWave and THz frequencies are well-suited for synthetic aperture radar (SAR) imaging at sub-millimeter resolutions for a wide spectrum of tasks like material characterization and nondestructive testing (NDT). This article provides a tutorial review of systems and algorithms for THz SAR in the near-field with an emphasis on emerging algorithms that combine signal processing and machine learning techniques. As part of this study, an overview of classical and data-driven THz SAR algorithms is provided, focusing on object detection for security applications and SAR image super-resolution. We also discuss relevant issues, challenges, and future research directions for emerging algorithms and THz SAR, including standardization of system and algorithm benchmarking, adoption of state-of-the-art deep learning techniques, signal processing-optimized machine learning, and hybrid data-driven signal processing algorithms...
△ Less
Submitted 15 September, 2023;
originally announced September 2023.
-
Efficient CNN-based Super Resolution Algorithms for mmWave Mobile Radar Imaging
Authors:
Christos Vasileiou,
Josiah W. Smith,
Shiva Thiagarajan,
Matthew Nigh,
Yiorgos Makris,
Murat Torlak
Abstract:
In this paper, we introduce an innovative super resolution approach to emerging modes of near-field synthetic aperture radar (SAR) imaging. Recent research extends convolutional neural network (CNN) architectures from the optical to the electromagnetic domain to achieve super resolution on images generated from radar signaling. Specifically, near-field synthetic aperture radar (SAR) imaging, a met…
▽ More
In this paper, we introduce an innovative super resolution approach to emerging modes of near-field synthetic aperture radar (SAR) imaging. Recent research extends convolutional neural network (CNN) architectures from the optical to the electromagnetic domain to achieve super resolution on images generated from radar signaling. Specifically, near-field synthetic aperture radar (SAR) imaging, a method for generating high-resolution images by scanning a radar across space to create a synthetic aperture, is of interest due to its high-fidelity spatial sensing capability, low cost devices, and large application space. Since SAR imaging requires large aperture sizes to achieve high resolution, super-resolution algorithms are valuable for many applications. Freehand smartphone SAR, an emerging sensing modality, requires irregular SAR apertures in the near-field and computation on mobile devices. Achieving efficient high-resolution SAR images from irregularly sampled data collected by freehand motion of a smartphone is a challenging task. In this paper, we propose a novel CNN architecture to achieve SAR image super-resolution for mobile applications by employing state-of-the-art SAR processing and deep learning techniques. The proposed algorithm is verified via simulation and an empirical study. Our algorithm demonstrates high-efficiency and high-resolution radar imaging for near-field scenarios with irregular scanning geometries.
△ Less
Submitted 3 May, 2023;
originally announced May 2023.
-
A Vision Transformer Approach for Efficient Near-Field Irregular SAR Super-Resolution
Authors:
Josiah Smith,
Yusef Alimam,
Geetika Vedula,
Murat Torlak
Abstract:
In this paper, we develop a novel super-resolution algorithm for near-field synthetic-aperture radar (SAR) under irregular scanning geometries. As fifth-generation (5G) millimeter-wave (mmWave) devices are becoming increasingly affordable and available, high-resolution SAR imaging is feasible for end-user applications and non-laboratory environments. Emerging applications such freehand imaging, wh…
▽ More
In this paper, we develop a novel super-resolution algorithm for near-field synthetic-aperture radar (SAR) under irregular scanning geometries. As fifth-generation (5G) millimeter-wave (mmWave) devices are becoming increasingly affordable and available, high-resolution SAR imaging is feasible for end-user applications and non-laboratory environments. Emerging applications such freehand imaging, wherein a handheld radar is scanned throughout space by a user, unmanned aerial vehicle (UAV) imaging, and automotive SAR face several unique challenges for high-resolution imaging. First, recovering a SAR image requires knowledge of the array positions throughout the scan. While recent work has introduced camera-based positioning systems capable of adequately estimating the position, recovering the algorithm efficiently is a requirement to enable edge and Internet of Things (IoT) technologies. Efficient algorithms for non-cooperative near-field SAR sampling have been explored in recent work, but suffer image defocusing under position estimation error and can only produce medium-fidelity images. In this paper, we introduce a mobile-friend vision transformer (ViT) architecture to address position estimation error and perform SAR image super-resolution (SR) under irregular sampling geometries. The proposed algorithm, Mobile-SRViT, is the first to employ a ViT approach for SAR image enhancement and is validated in simulation and via empirical studies.
△ Less
Submitted 27 June, 2023; v1 submitted 3 May, 2023;
originally announced May 2023.
-
Efficient 3-D Near-Field MIMO-SAR Imaging for Irregular Scanning Geometries
Authors:
Josiah Smith,
Murat Torlak
Abstract:
In this article, we introduce a novel algorithm for efficient near-field synthetic aperture radar (SAR) imaging for irregular scanning geometries. With the emergence of fifth-generation (5G) millimeter-wave (mmWave) devices, near-field SAR imaging is no longer confined to laboratory environments. Recent advances in positioning technology have attracted significant interest for a diverse set of new…
▽ More
In this article, we introduce a novel algorithm for efficient near-field synthetic aperture radar (SAR) imaging for irregular scanning geometries. With the emergence of fifth-generation (5G) millimeter-wave (mmWave) devices, near-field SAR imaging is no longer confined to laboratory environments. Recent advances in positioning technology have attracted significant interest for a diverse set of new applications in mmWave imaging. However, many use cases, such as automotive-mounted SAR imaging, unmanned aerial vehicle (UAV) imaging, and freehand imaging with smartphones, are constrained to irregular scanning geometries. Whereas traditional near-field SAR imaging systems and quick personnel security (QPS) scanners employ highly precise motion controllers to create ideal synthetic arrays, emerging applications, mentioned previously, inherently cannot achieve such ideal positioning. In addition, many Internet of Things (IoT) and 5G applications impose strict size and computational complexity limitations that must be considered for edge mmWave imaging technology. In this study, we propose a novel algorithm to leverage the advantages of non-cooperative SAR scanning patterns, small form-factor multiple-input multiple-output (MIMO) radars, and efficient monostatic planar image reconstruction algorithms. We propose a framework to mathematically decompose arbitrary and irregular sampling geometries and a joint solution to mitigate multistatic array imaging artifacts. The proposed algorithm is validated through simulations and an empirical study of arbitrary scanning scenarios. Our algorithm achieves high-resolution and high-efficiency near-field MIMO-SAR imaging, and is an elegant solution to computationally constrained irregularly sampled imaging problems.
△ Less
Submitted 3 May, 2023;
originally announced May 2023.
-
Improved Static Hand Gesture Classification on Deep Convolutional Neural Networks using Novel Sterile Training Technique
Authors:
Josiah Smith,
Shiva Thiagarajan,
Richard Willis,
Yiorgos Makris,
Murat Torlak
Abstract:
In this paper, we investigate novel data collection and training techniques towards improving classification accuracy of non-moving (static) hand gestures using a convolutional neural network (CNN) and frequency-modulated-continuous-wave (FMCW) millimeter-wave (mmWave) radars. Recently, non-contact hand pose and static gesture recognition have received considerable attention in many applications r…
▽ More
In this paper, we investigate novel data collection and training techniques towards improving classification accuracy of non-moving (static) hand gestures using a convolutional neural network (CNN) and frequency-modulated-continuous-wave (FMCW) millimeter-wave (mmWave) radars. Recently, non-contact hand pose and static gesture recognition have received considerable attention in many applications ranging from human-computer interaction (HCI), augmented/virtual reality (AR/VR), and even therapeutic range of motion for medical applications. While most current solutions rely on optical or depth cameras, these methods require ideal lighting and temperature conditions. mmWave radar devices have recently emerged as a promising alternative offering low-cost system-on-chip sensors whose output signals contain precise spatial information even in non-ideal imaging conditions. Additionally, deep convolutional neural networks have been employed extensively in image recognition by learning both feature extraction and classification simultaneously. However, little work has been done towards static gesture recognition using mmWave radars and CNNs due to the difficulty involved in extracting meaningful features from the radar return signal, and the results are inferior compared with dynamic gesture classification. This article presents an efficient data collection approach and a novel technique for deep CNN training by introducing ``sterile'' images which aid in distinguishing distinct features among the static gestures and subsequently improve the classification accuracy. Applying the proposed data collection and training methods yields an increase in classification rate of static hand gestures from $85\%$ to $93\%$ and $90\%$ to $95\%$ for range and range-angle profiles, respectively.
△ Less
Submitted 3 May, 2023;
originally announced May 2023.
-
Near-Field MIMO-ISAR Millimeter-Wave Imaging
Authors:
Josiah W. Smith,
Muhammet Emin Yanik,
Murat Torlak
Abstract:
Multiple-input-multiple-output (MIMO) millimeter-wave (mmWave) sensors for synthetic aperture radar (SAR) and inverse SAR (ISAR) address the fundamental challenges of cost-effectiveness and scalability inherent to near-field imaging. In this paper, near-field MIMO-ISAR mmWave imaging systems are discussed and developed. The rotational ISAR (R-ISAR) regime investigated in this paper requires rotati…
▽ More
Multiple-input-multiple-output (MIMO) millimeter-wave (mmWave) sensors for synthetic aperture radar (SAR) and inverse SAR (ISAR) address the fundamental challenges of cost-effectiveness and scalability inherent to near-field imaging. In this paper, near-field MIMO-ISAR mmWave imaging systems are discussed and developed. The rotational ISAR (R-ISAR) regime investigated in this paper requires rotating the target at a constant radial distance from the transceiver and scanning the transceiver along a vertical track. Using a 77GHz mmWave radar, a high resolution three-dimensional (3-D) image can be reconstructed from this two-dimensional scanning taking into account the spherical near-field wavefront. While prior work in literature consists of single-input-single-output circular synthetic aperture radar (SISO-CSAR) algorithms or computationally sluggish MIMO-CSAR image reconstruction algorithms, this paper proposes a novel algorithm for efficient MIMO 3-D holographic imaging and details the design of a MIMO R-ISAR imaging system. The proposed algorithm applies a multistatic-to-monostatic phase compensation to the R-ISAR regime allowing for use of highly efficient monostatic algorithms. We demonstrate the algorithm's performance in real-world imaging scenarios on a prototyped MIMO R-ISAR platform. Our fully integrated system, consisting of a mechanical scanner and efficient imaging algorithm, is capable of pairing the scanning efficiency of the MIMO regime with the computational efficiency of single pixel image reconstruction algorithms.
△ Less
Submitted 3 May, 2023;
originally announced May 2023.
-
Deep Learning-Based Multiband Signal Fusion for 3-D SAR Super-Resolution
Authors:
Josiah Smith,
Murat Torlak
Abstract:
Three-dimensional (3-D) synthetic aperture radar (SAR) is widely used in many security and industrial applications requiring high-resolution imaging of concealed or occluded objects. The ability to resolve intricate 3-D targets is essential to the performance of such applications and depends directly on system bandwidth. However, because high-bandwidth systems face several prohibitive hurdles, an…
▽ More
Three-dimensional (3-D) synthetic aperture radar (SAR) is widely used in many security and industrial applications requiring high-resolution imaging of concealed or occluded objects. The ability to resolve intricate 3-D targets is essential to the performance of such applications and depends directly on system bandwidth. However, because high-bandwidth systems face several prohibitive hurdles, an alternative solution is to operate multiple radars at distinct frequency bands and fuse the multiband signals. Current multiband signal fusion methods assume a simple target model and a small number of point reflectors, which is invalid for realistic security screening and industrial imaging scenarios wherein the target model effectively consists of a large number of reflectors. To the best of our knowledge, this study presents the first use of deep learning for multiband signal fusion. The proposed network, called kR-Net, employs a hybrid, dual-domain complex-valued convolutional neural network (CV-CNN) to fuse multiband signals and impute the missing samples in the frequency gaps between subbands. By exploiting the relationships in both the wavenumber domain and wavenumber spectral domain, the proposed framework overcomes the drawbacks of existing multiband imaging techniques for realistic scenarios at a fraction of the computation time of existing multiband fusion algorithms. Our method achieves high-resolution imaging of intricate targets previously impossible using conventional techniques and enables finer resolution capacity for concealed weapon detection and occluded object classification using multiband signaling without requiring more advanced hardware. Furthermore, a fully integrated multiband imaging system is developed using commercially available millimeter-wave (mmWave) radars for efficient multiband imaging.
△ Less
Submitted 3 May, 2023;
originally announced May 2023.
-
An FCNN-Based Super-Resolution mmWave Radar Framework for Contactless Musical Instrument Interface
Authors:
Josiah W. Smith,
Orges Furxhi,
Murat Torlak
Abstract:
In this article, we propose a framework for contactless human-computer interaction (HCI) using novel tracking techniques based on deep learning-based super-resolution and tracking algorithms. Our system offers unprecedented high-resolution tracking of hand position and motion characteristics by leveraging spatial and temporal features embedded in the reflected radar waveform. Rather than classifyi…
▽ More
In this article, we propose a framework for contactless human-computer interaction (HCI) using novel tracking techniques based on deep learning-based super-resolution and tracking algorithms. Our system offers unprecedented high-resolution tracking of hand position and motion characteristics by leveraging spatial and temporal features embedded in the reflected radar waveform. Rather than classifying samples from a predefined set of hand gestures, as common in existing work on deep learning with mmWave radar, our proposed imager employs a regressive full convolutional neural network (FCNN) approach to improve localization accuracy by spatial super-resolution. While the proposed techniques are suitable for a host of tracking applications, this article focuses on their application as a musical interface to demonstrate the robustness of the gesture sensing pipeline and deep learning signal processing chain. The user can control the instrument by varying the position and velocity of their hand above the vertically-facing sensor. By employing a commercially available multiple-input-multiple-output (MIMO) radar rather than a traditional optical sensor, our framework demonstrates the efficacy of the mmWave sensing modality for fine motion tracking and offers an elegant solution to a host of HCI tasks. Additionally, we provide a freely available software package and user interface for controlling the device, streaming the data to MATLAB in real-time, and increasing accessibility to the signal processing and device interface functionality utilized in this article.
△ Less
Submitted 3 May, 2023;
originally announced May 2023.
-
Second-Order Statistics of MIMO Rayleigh Interference Channels: Theory, Applications, and Analysis
Authors:
Ahmed O. D. Ali,
Cenk M. Yetis,
Murat Torlak
Abstract:
While first-order channel statistics, such as bit-error rate (BER) and outage probability, play an important role in the design of wireless communication systems, they provide information only on the static behavior of fading channels. On the other hand, second-order statistics, such as level crossing rate (LCR) and average outage duration (AOD), capture the correlation properties of fading channe…
▽ More
While first-order channel statistics, such as bit-error rate (BER) and outage probability, play an important role in the design of wireless communication systems, they provide information only on the static behavior of fading channels. On the other hand, second-order statistics, such as level crossing rate (LCR) and average outage duration (AOD), capture the correlation properties of fading channels, hence, are used in system design notably in packet-based transmission systems. In this paper, exact closed-form expressions are derived for the LCR and AOD of the signal at a receiver where maximal-ratio combining (MRC) is deployed over flat Rayleigh fading channels in the presence of additive white Gaussian noise (AWGN) and co-channel interferers with unequal transmitting powers and unequal speeds. Moreover, in order to gain insight on the LCR behavior, a simplified approximate expression for the LCR is presented. As an application of LCR in system designs, the packet error rate (PER) is evaluated through finite state Markov chain (FSMC) model. Finally, as another application again by using the FSMC model, the optimum packet length to maximize the throughput of the system with stop-and-wait automatic repeat request (SW-ARQ) protocol is derived. Simulation results validating the presented expressions are provided.
△ Less
Submitted 1 September, 2015;
originally announced September 2015.
-
Two Dimensional Array Imaging with Beam Steered Data
Authors:
Sujeet Patole,
Murat Torlak
Abstract:
This paper discusses different approaches used for millimeter wave imaging of two-dimensional objects. Imaging of a two dimensional object requires reflected wave data to be collected across two distinct dimensions. In this paper, we propose a reconstruction method that uses narrowband waveforms along with two dimensional beam steering. The beam is steered in azimuthal and elevation direction, whi…
▽ More
This paper discusses different approaches used for millimeter wave imaging of two-dimensional objects. Imaging of a two dimensional object requires reflected wave data to be collected across two distinct dimensions. In this paper, we propose a reconstruction method that uses narrowband waveforms along with two dimensional beam steering. The beam is steered in azimuthal and elevation direction, which forms the two distinct dimensions required for the reconstruction. The Reconstruction technique uses inverse Fourier transform along with amplitude and phase correction factors. In addition, this reconstruction technique does not require interpolation of the data in either wavenumber or spatial domain. Use of the two dimensional beam steering offers better performance in the presence of noise compared with the existing methods, such as switched array imaging system. Effects of RF impairments such as quantization of the phase of beam steering weights and timing jitter which add to phase noise, are analyzed.
△ Less
Submitted 17 April, 2014; v1 submitted 24 October, 2013;
originally announced October 2013.
-
Exact Joint Distribution Analysis of Zero-Forcing V-BLAST Gains with Greedy Ordering
Authors:
Serdar Ozyurt,
Murat Torlak
Abstract:
We derive the joint probability distribution of zero-forcing (ZF) V-BLAST gains under a greedy selection of decoding order and no error propagation. Unlike the previous approximated analyses, a mathematical framework is built by applying order statistics rules and an exact closed-form joint probability density function expression for squared layer gains is obtained. Our analysis relies on the fact…
▽ More
We derive the joint probability distribution of zero-forcing (ZF) V-BLAST gains under a greedy selection of decoding order and no error propagation. Unlike the previous approximated analyses, a mathematical framework is built by applying order statistics rules and an exact closed-form joint probability density function expression for squared layer gains is obtained. Our analysis relies on the fact that all orderings are equiprobable under independent and identical Rayleigh fading. Based on this idea, we determine the joint distribution of the ordered gains from the joint distribution of the unordered gains. Our results are applicable for any number of transmit and receive antennas. Although we present our analysis in a ZF V-BLAST setting, our analytical results can be directly applied for the dual cases of ZF V-BLAST. Under the assumption of a low rate feedback of decoding order to the transmitter, a benefit of having exact expressions is illustrated by the calculation of the cutoff value under optimal power allocation that maximizes the sum of the substream outage capacities under a given sum power constraint. We provide numerical results and verify our analysis by means of simulations.
△ Less
Submitted 23 September, 2013;
originally announced September 2013.
-
Performance Analysis of Optimum Zero-Forcing Beamforming with Greedy User Selection
Authors:
Serdar Ozyurt,
Murat Torlak
Abstract:
In this letter, an exact performance analysis is presented on the sum rate of zero-forcing beamforming with a greedy user scheduling algorithm in a downlink system. Adopting water-filling power allocation, we derive a compact form for the joint probability density function of the scheduled users' squared subchannel gains when a transmitter with multiple antennas sends information to at most two sc…
▽ More
In this letter, an exact performance analysis is presented on the sum rate of zero-forcing beamforming with a greedy user scheduling algorithm in a downlink system. Adopting water-filling power allocation, we derive a compact form for the joint probability density function of the scheduled users' squared subchannel gains when a transmitter with multiple antennas sends information to at most two scheduled users with each having a single antenna. The analysis is verified by numerical results.
△ Less
Submitted 19 July, 2013;
originally announced July 2013.
-
Unified Performance Analysis of Orthogonal Transmit Beamforming Methods with User Selection
Authors:
Serdar Ozyurt,
Murat Torlak
Abstract:
Simultaneous multiuser beamforming in multiantenna downlink channels can entail dirty paper (DP) precoding (optimal and high complexity) or linear precoding (suboptimal and low complexity) approaches. The system performance is typically characterized by the sum capacity with homogenous users with perfect channel state information at the transmitter. The sum capacity performance analysis requires t…
▽ More
Simultaneous multiuser beamforming in multiantenna downlink channels can entail dirty paper (DP) precoding (optimal and high complexity) or linear precoding (suboptimal and low complexity) approaches. The system performance is typically characterized by the sum capacity with homogenous users with perfect channel state information at the transmitter. The sum capacity performance analysis requires the exact probability distributions of the user signal-to-noise ratios (SNRs) or signal-to-interference plus noise ratios (SINRs). The standard techniques from order statistics can be sufficient to obtain the probability distributions of SNRs for DP precoding due to the removal of known interference at the transmitter. Derivation of such probability distributions for linear precoding techniques on the other hand is much more challenging. For example, orthogonal beamforming techniques do not completely cancel the interference at the user locations, thereby requiring the analysis with SINRs. In this paper, we derive the joint probability distributions of the user SINRs for two orthogonal beamforming methods combined with user scheduling: adaptive orthogonal beamforming and orthogonal linear beamforming. We obtain compact and unified solutions for the joint probability distributions of the scheduled users' SINRs. Our analytical results can be applied for similar algorithms and are verified by computer simulations.
△ Less
Submitted 19 July, 2013;
originally announced July 2013.
-
Interference Alignment via Improved Subspace Conditioning
Authors:
Douglas Kim,
Murat Torlak
Abstract:
For the K user, single input single output (SISO), frequency selective interference channel, a new low complexity transmit beamforming design that improves the achievable sum rate is presented. Jointly employing the interference alignment (IA) scheme presented by Cadambe and Jafar in [1] and linear minimum mean square error (MMSE) decoding at the transmitters and receivers, respectively, the new I…
▽ More
For the K user, single input single output (SISO), frequency selective interference channel, a new low complexity transmit beamforming design that improves the achievable sum rate is presented. Jointly employing the interference alignment (IA) scheme presented by Cadambe and Jafar in [1] and linear minimum mean square error (MMSE) decoding at the transmitters and receivers, respectively, the new IA precoding design improves the average sum rate while preserving the achievable degrees of freedom of the Cadambe and Jafar scheme, K/2.
△ Less
Submitted 30 November, 2010;
originally announced November 2010.