Showing 1–50 of 63 results for author: Buehrer, R M

3D Positioning using a New Diffraction Path Model

Authors: Gaurav Duggal, R. Michael Buehrer, Harpreet S. Dhillon, Jeffrey H. Reed

Abstract: Enhancing 3D and Z-axis positioning accuracy is crucial for effective rescue in indoor emergencies, ensuring safety for emergency responders and at-risk individuals. Additionally, reducing the dependence of a positioning system on fixed infrastructure is crucial, given its vulnerability to power failures and damage during emergencies. Further challenges from a signal propagation perspective includ… ▽ More Enhancing 3D and Z-axis positioning accuracy is crucial for effective rescue in indoor emergencies, ensuring safety for emergency responders and at-risk individuals. Additionally, reducing the dependence of a positioning system on fixed infrastructure is crucial, given its vulnerability to power failures and damage during emergencies. Further challenges from a signal propagation perspective include poor indoor signal coverage, multipath effects and the problem of Non-Line-OfSight (NLOS) measurement bias. In this study, we utilize the mobility provided by a rapidly deployable Uncrewed Aerial Vehicle (UAV) based wireless network to address these challenges. We recognize diffraction from window edges as a crucial signal propagation mechanism and employ the Geometrical Theory of Diffraction (GTD) to introduce a novel NLOS path length model. Using this path length model, we propose two different techniques to improve the indoor positioning performance for emergency scenarios. △ Less

Submitted 9 May, 2024; originally announced May 2024.

Comments: Accepted for publication in ICC 2024

Mode Selection in Cognitive Radar Networks

Authors: William W. Howard, Samuel R. Shebert, Anthony F. Martone, R. Michael Buehrer

Abstract: Cognitive Radar Networks, which were popularized by Simon Haykin in 2006, have been proposed to address limitations with legacy radar installations. These limitations include large physical size, power consumption, fixed operating parameters, and single point vulnerabilities. Cognitive radar solves part of this problem through adaptability, using biologically inspired techniques to observe the env… ▽ More Cognitive Radar Networks, which were popularized by Simon Haykin in 2006, have been proposed to address limitations with legacy radar installations. These limitations include large physical size, power consumption, fixed operating parameters, and single point vulnerabilities. Cognitive radar solves part of this problem through adaptability, using biologically inspired techniques to observe the environment and adjust operation accordingly. Cognitive radar networks (CRNs) extend the capabilities of cognitive radar spatially, providing the opportunity to observe targets from multiple angles to mitigate stealth effects; distribute resources over space and in time; obtain better tracking performance; and gain more information from a scene. Often, problems of cognition in CRNs are viewed through the lens of iterative learning problems - one or multiple cognitive processes are implemented in the network, where each process first observes the environment, then selects operating parameters (from discrete or continuous options) using the history of observations and previous rewards, then repeats the cycle. Further, cognitive radar networks often are modeled with a flexible architecture and wide-bandwidth front-ends, enabling the addition of electronic support measures such as passive signal estimation. In this work we consider questions of the form "How should a cognitive radar network choose when to observe targets?" and "How can a cognitive radar network reduce the amount of energy it uses?". We implement tools from the multi-armed bandit and age of information literature to select modes for the network, choosing either an active radar mode or a passive signal estimation mode. We show that through the use of target classes, the network can determine how often each target should be observed to optimize tracking performance. △ Less

Submitted 4 April, 2024; v1 submitted 30 November, 2023; originally announced December 2023.

Comments: 13 pages, 11 figures

Mode Selection and Target Classification in Cognitive Radar Networks

Authors: William W. Howard, Samuel R. Shebert, Benjamin H. Kirk, R. Michael Buehrer

Abstract: Cognitive Radar Networks were proposed by Simon Haykin in 2006 to address problems with large legacy radar implementations - primarily, single-point vulnerabilities and lack of adaptability. This work proposes to leverage the adaptability of cognitive radar networks to trade between active radar observation, which uses high power and risks interception, and passive signal parameter estimation, whi… ▽ More Cognitive Radar Networks were proposed by Simon Haykin in 2006 to address problems with large legacy radar implementations - primarily, single-point vulnerabilities and lack of adaptability. This work proposes to leverage the adaptability of cognitive radar networks to trade between active radar observation, which uses high power and risks interception, and passive signal parameter estimation, which uses target emissions to gain side information and lower the power necessary to accurately track multiple targets. The goal of the network is to learn over many target tracks both the characteristics of the targets as well as the optimal action choices for each type of target. In order to select between the available actions, we utilize a multi-armed bandit model, using current class information as prior information. When the active radar action is selected, the node estimates the physical behavior of targets through the radar emissions. When the passive action is selected, the node estimates the radio behavior of targets through passive sensing. Over many target tracks, the network collects the observed behavior of targets and forms clusters of similarly-behaved targets. In this way, the network meta-learns the target class distributions while learning the optimal mode selections for each target class. △ Less

Submitted 25 October, 2023; originally announced October 2023.

Comments: 6 pages, 5 figures

Open and Closed-Loop Weight Selection for Pattern Control of Paraboloidal Reflector Antennas with Reconfigurable Rim Scattering

Authors: R. Michael Buehrer, William W. Howard, Steven Ellingson

Abstract: It has been demonstrated that modifying the rim scattering of a paraboloidal reflector antenna through the use of reconfigurable elements along the rim facilitates sidelobe modification including cancelling sidelobes. In this work we investigate several open questions with respect to algorithms for determining the weights. First, we derive the general weight values needed at each reconfigurable el… ▽ More It has been demonstrated that modifying the rim scattering of a paraboloidal reflector antenna through the use of reconfigurable elements along the rim facilitates sidelobe modification including cancelling sidelobes. In this work we investigate several open questions with respect to algorithms for determining the weights. First, we derive the general weight values needed at each reconfigurable element to place nulls at arbitrary angles. Second, since in many cases these weights require gains other than one, we develop a technique for determining unit-modulus weights so as to allow for surfaces which merely modify the phase of the scattered field, while substantially reducing the gain at arbitrary angles. Specifically, it is shown that despite the large search space (and non-convexity in the presence of discrete weights), weights can be found with reasonable computational complexity which provide useful cancellation capability. Third, it is demonstrated that this can be done using open-loop (i.e., with pattern knowledge), closed-loop (without pattern knowledge), or hybrid (with inexact pattern knowledge) techniques both quantized and unquantized phases. A primary finding is that sufficiently deep nulls are possible with essentially no change in the main lobe gain with practical (binary or quaternary) phase-only weights. △ Less

Submitted 26 February, 2024; v1 submitted 30 August, 2023; originally announced August 2023.

Comments: 16 pages, 19 figures. arXiv admin note: substantial text overlap with arXiv:2202.13219

Timely Target Tracking: Distributed Updating in Cognitive Radar Networks

Authors: William W. Howard, Anthony F. Martone, R. Michael Buehrer

Abstract: Cognitive radar networks (CRNs) are capable of optimizing operating parameters in order to provide actionable information to an operator or secondary system. CRNs have been proposed to answer the need for low-cost devices tracking potentially large numbers of targets in geographically diverse regions. Networks of small-scale devices have also been shown to outperform legacy, large scale, high pric… ▽ More Cognitive radar networks (CRNs) are capable of optimizing operating parameters in order to provide actionable information to an operator or secondary system. CRNs have been proposed to answer the need for low-cost devices tracking potentially large numbers of targets in geographically diverse regions. Networks of small-scale devices have also been shown to outperform legacy, large scale, high price, single-device installations. In this work, we consider a CRN tracking multiple targets with a goal of providing information which is both fresh and accurate to a measurement fusion center (FC). We show that under a constraint on the update rate of each radar node, the network is able to utilize Age of Information (AoI) metrics to maximize the resource utilization and minimize error per track. Since information freshness is critical to decision-making, this structure enables a CRN to provide the highest-quality information possible to a downstream system or operator. We discuss centralized and distributed approaches to solving this problem, taking into account the quality of node observations, the maneuverability of each target, and a limit on the rate at which any node may provide updates to the FC. We present a centralized AoI-inspired node selection metric, where a FC requests updates from specific nodes. We compare this against several alternative techniques. Further, we provide a distributed approach which utilizes the Age of Incorrect Information (AoII) metric, allowing each independent node to provide updates according to the targets it can observe. We provide mathematical analysis of the rate limits defined for the centralized and distributed approaches, showing that they are equivalent. We conclude with numerical simulations demonstrating that the performance of the algorithms exceeds that of alternative approaches, both in resource utilization and in tracking performance. △ Less

Submitted 2 March, 2024; v1 submitted 24 July, 2023; originally announced July 2023.

Comments: 15 pages, double column, 14 figures

RIS-Aided Kinematic Analysis for Remote Rehabilitation

Authors: Don-Roberts Emenonye, Anik Sarker, Alan T. Asbeck, Harpreet S. Dhillon, R. Michael Buehrer

Abstract: This paper is the first to introduce the idea of using reconfigurable intelligent surfaces (RISs) as passive devices that measure the position and orientation of certain human body parts over time. In this paper, we investigate the possibility of utilizing the available geometric information provided by on-body RISs that reflect signals from an off-body transmitter to an off-body receiver for stro… ▽ More This paper is the first to introduce the idea of using reconfigurable intelligent surfaces (RISs) as passive devices that measure the position and orientation of certain human body parts over time. In this paper, we investigate the possibility of utilizing the available geometric information provided by on-body RISs that reflect signals from an off-body transmitter to an off-body receiver for stroke rehabilitation. More specifically, we investigate the possibility of using on-body RISs to estimate the location information over time of upper limbs that may have been impaired due to stroke. This location information can help medical professionals to estimate the possibly time varying pose and obtain progress on the rehabilitation of the upper limbs. Our analysis is focused on two scenarios: i) after assessment exercises for stroke rehabilitation when the upper limbs are resting at predefined points in the rehabilitation center, and ii) during the assessment exercises. In the first scenario, we explore the possibility of upper limb orientation estimation by deriving the Fisher information matrix (FIM) under near-field and far-field propagation conditions. It is noteworthy that the FIM quantifies how accurately we can estimate location information from a signal, and any subsequent algorithm is bounded by a function of the FIM. Coming to our propagation assumptions, the difference between the near-field and far-field regimes lies in the curvature of the wavefront. In the near-field, a receiver experiences a spherical wavefront, whereas in the far-field, the wavefront is approximately linear. The threshold to be within the near-field can be on the order of $10 \text{ m}.$ △ Less

Submitted 30 June, 2023; originally announced July 2023.

On the Limits of Single Anchor Localization: Near-Field vs Far-Field

Authors: Don-Roberts Emenonye, Harpreet S. Dhillon, R. Michael Buehrer

Abstract: It is well known that a single anchor can be used to determine the position and orientation of an agent communicating with it. However, it is not clear what information about the anchor or the agent is necessary to perform this localization, especially when the agent is in the near-field of the anchor. Hence, in this paper, to investigate the limits of localizing an agent with some uncertainty in… ▽ More It is well known that a single anchor can be used to determine the position and orientation of an agent communicating with it. However, it is not clear what information about the anchor or the agent is necessary to perform this localization, especially when the agent is in the near-field of the anchor. Hence, in this paper, to investigate the limits of localizing an agent with some uncertainty in the anchor location, we consider a wireless link consisting of source and destination nodes. More specifically, we present a Fisher information theoretical investigation of the possibility of estimating different combinations of the source and destination's position and orientation from the signal received at the destination. To present a comprehensive study, we perform this Fisher information theoretic investigation under both the near and far field propagation models. One of the key insights is that while the source or destination's $3$D orientation can be jointly estimated with the source or destination's $3$D position in the near-field propagation regime, only the source or destination's $2$D orientation can be jointly estimated with the source or destination's $2$D position in the far-field propagation regime. Also, a simulation of the FIM indicates that in the near-field, we can estimate the source's $3$D orientation angles with no beamforming, but in the far-field, we can not estimate the source's $2$D orientation angles when no beamforming is employed. △ Less

Submitted 30 June, 2023; originally announced July 2023.

Design of Rim-Located Reconfigurable Reflectarrays for Interference Mitigation in Reflector Antennas

Authors: Jordan Budhu, Sean V. Hum, Steven Ellingson, R. Michael Buehrer

Abstract: Radio telescopes are susceptible to interference arriving through its sidelobes. If a reflector antenna could be retrofitted with an adaptive null steering system, it could potentially mitigate this interference. The design of a reflectarray which can be used to reconfigure a radio telescopes radiation pattern by driving a null to the angle of incoming interference is presented. The reflectarray o… ▽ More Radio telescopes are susceptible to interference arriving through its sidelobes. If a reflector antenna could be retrofitted with an adaptive null steering system, it could potentially mitigate this interference. The design of a reflectarray which can be used to reconfigure a radio telescopes radiation pattern by driving a null to the angle of incoming interference is presented. The reflectarray occupies only a portion of the rim of the original reflector and lays conformal to the paraboloid within this region. The conformal reflectarray contains unit cells with 1-bit reconfigurability stemming from two symmetrically placed PIN diodes. It is found that the dielectric and switch losses introduced by the reflectarray do not significantly affect the radio telescopes efficiency since the reflectarray is placed only along the outer rim of the reflector which is weakly illuminated. Simulation results of an L-band reconfigurable reflectarray for an 18m prime focus fed parabola are presented. △ Less

Submitted 21 December, 2023; v1 submitted 29 May, 2023; originally announced May 2023.

NTN-based 6G Localization: Vision, Role of LEOs, and Open Problems

Authors: Harish K. Dureppagari, Chiranjib Saha, Harpreet S. Dhillon, R. Michael Buehrer

Abstract: Since the introduction of 5G Release 18, non-terrestrial networks (NTNs) based positioning has garnered significant interest due to its numerous applications, including emergency services, lawful intercept, and charging and tariff services. This release considers single low-earth-orbit (LEO) positioning explicitly for $\textit{location verification}$ purposes, which requires a fairly coarse locati… ▽ More Since the introduction of 5G Release 18, non-terrestrial networks (NTNs) based positioning has garnered significant interest due to its numerous applications, including emergency services, lawful intercept, and charging and tariff services. This release considers single low-earth-orbit (LEO) positioning explicitly for $\textit{location verification}$ purposes, which requires a fairly coarse location estimate. To understand the future trajectory of NTN-based localization in 6G, we first provide a comprehensive overview of the evolution of 3rd Generation Partnership Project (3GPP) localization techniques, with specific emphasis on the current activities in 5G related to NTN location verification. We then delineate the suitability of LEOs for location-based services and emphasize increased interest in LEO-based positioning. In order to provide support for more accurate positioning in 6G using LEOs, we identify two NTN positioning systems that are likely study items for 6G: (i) multi-LEO positioning, and (ii) augmenting single-LEO and multi-LEO setups with Global Navigation Satellite System (GNSS), especially when an insufficient number of GNSS satellites (such as 2) are visible. We evaluate the accuracy of both systems through a 3GPP-compliant simulation study using a Cramér-Rao lower bound (CRLB) analysis. Our findings suggest that NTN technology has significant potential to provide accurate positioning of UEs in scenarios where GNSS signals may be weak or unavailable, but there are technical challenges in accommodating these solutions in 3GPP. We conclude with a discussion on the research landscape and key open problems related to NTN-based positioning. △ Less

Submitted 7 September, 2023; v1 submitted 20 May, 2023; originally announced May 2023.

Comments: 7 pages, 6 figures, submitted to IEEE Wireless Communications Magazine

On the Value of Online Learning for Radar Waveform Selection

Authors: Charles E. Thornton, R. Michael Buehrer

Abstract: This paper attempts to characterize the kinds of physical scenarios in which an online learning-based cognitive radar is expected to reliably outperform a fixed rule-based waveform selection strategy, as well as the converse. We seek general insights through an examination of two decision-making scenarios, namely dynamic spectrum access and multiple-target tracking. The radar scene is characterize… ▽ More This paper attempts to characterize the kinds of physical scenarios in which an online learning-based cognitive radar is expected to reliably outperform a fixed rule-based waveform selection strategy, as well as the converse. We seek general insights through an examination of two decision-making scenarios, namely dynamic spectrum access and multiple-target tracking. The radar scene is characterized by inducing a state-space model and examining the structure of its underlying Markov state transition matrix, in terms of entropy rate and diagonality. It is found that entropy rate is a strong predictor of online learning-based waveform selection, while diagonality is a better predictor of fixed rule-based waveform selection. We show that these measures can be used to predict first and second-order stochastic dominance relationships, which can allow system designers to make use of simple decision rules instead of more cumbersome learning approaches under certain conditions. We validate our findings through numerical results for each application and provide guidelines for future implementations. △ Less

Submitted 6 September, 2023; v1 submitted 21 April, 2023; originally announced April 2023.

Comments: 15 pages, 15 figures. Final version to appear in IEEE Transaction on Radar Systems. arXiv admin note: substantial text overlap with arXiv:2212.00597

Line-of-Sight Probability for Outdoor-to-Indoor UAV-Assisted Emergency Networks

Authors: Gaurav Duggal, R. Michael Buehrer, Nishith Tripathi, Jeffrey H. Reed

Abstract: For emergency response scenarios like firefighting in urban environments, there is a need to both localize emergency responders inside the building and also support a high bandwidth communication link between the responders and a command-and-control center. The emergency networks for such scenarios can be established with the quick deployment of Unmanned Aerial Vehicles (UAVs). Further, the 3D mob… ▽ More For emergency response scenarios like firefighting in urban environments, there is a need to both localize emergency responders inside the building and also support a high bandwidth communication link between the responders and a command-and-control center. The emergency networks for such scenarios can be established with the quick deployment of Unmanned Aerial Vehicles (UAVs). Further, the 3D mobility of UAVs can be leveraged to improve the quality of the wireless link by maneuvering them into advantageous locations. This has motivated recent propagation measurement campaigns to study low-altitude air-to-ground channels in both 5G-sub6 GHz and 5G-mmWave bands. In this paper, we develop a model for the link in a UAV-assisted emergency location and/or communication system. Specifically, given the importance of Line-of-Sight (LoS) links in localization as well as mmWave communication, we derive a closed-form expression for the LoS probability. This probability is parameterized by the UAV base station location, the size of the building, and the size of the window that offers the best propagation path. An expression for coverage probability is also derived. The LoS probability and coverage probabilities derived in this paper can be used to analyze the outdoor UAV-to-indoor propagation environment to determine optimal UAV positioning and the number of UAVs needed to achieve the desired performance of the emergency network. △ Less

Submitted 26 February, 2023; originally announced February 2023.

Comments: Accepted to be published in IEEE ICC 2023, Rome, Italy

Open Set Wireless Signal Classification: Augmenting Deep Learning with Expert Feature Classifiers

Authors: Samuel R. Shebert, Benjamin H. Kirk, R. Michael Buehrer

Abstract: In shared spectrum with multiple radio access technologies, wireless standard classification is vital for applications such as dynamic spectrum access (DSA) and wideband spectrum monitoring. However, interfering signals and the presence of unknown classes of signals can diminish classification accuracy. To reduce interference, signals can be isolated in time, frequency, and space, but the isolatio… ▽ More In shared spectrum with multiple radio access technologies, wireless standard classification is vital for applications such as dynamic spectrum access (DSA) and wideband spectrum monitoring. However, interfering signals and the presence of unknown classes of signals can diminish classification accuracy. To reduce interference, signals can be isolated in time, frequency, and space, but the isolation process adds distortion that reduces the accuracy of deep learning classifiers. We find that the distortion can be partially mitigated by augmenting the classifier training data with the signal isolation steps. To address unknown signals, we propose an open set hybrid classifier, which combines deep learning and expert feature classifiers to leverage the reliability and explainability of expert feature classifiers and the lower computational complexity of deep learning classifiers. The hybrid classifier reduces the computational complexity by 2 to 7 times on average compared to the expert feature classifiers, while achieving an accuracy of 95% at 15 dB SNR for known signal classes. The hybrid classifier manages to detect unknown classes at nearly 100% accuracy, due to the robustness of the expert feature classifiers. △ Less

Submitted 7 February, 2023; originally announced February 2023.

Hybrid Cognition for Target Tracking in Cognitive Radar Networks

Authors: William W. Howard, R. Michael Buehrer

Abstract: This work investigates online learning techniques for a cognitive radar network utilizing feedback from a central coordinator. The available spectrum is divided into channels, and each radar node must transmit in one channel per time step. The network attempts to optimize radar tracking accuracy by learning the optimal channel selection for spectrum sharing and radar performance. We define optimal… ▽ More This work investigates online learning techniques for a cognitive radar network utilizing feedback from a central coordinator. The available spectrum is divided into channels, and each radar node must transmit in one channel per time step. The network attempts to optimize radar tracking accuracy by learning the optimal channel selection for spectrum sharing and radar performance. We define optimal selection for such a network in relation to the radar observation quality obtainable in a given channel. This is a difficult problem since the network must seek the optimal assignment from nodes to channels, rather than just seek the best overall channel. Since the presence of primary users appears as interference, the approach also improves spectrum sharing performance. In other words, maximizing radar performance also minimizes interference to primary users. Each node is able to learn the quality of several available channels through repeated sensing. We define hybrid cognition as the condition where both the independent radar nodes as well as the central coordinator are modeled as cognitive agents, with restrictions on the amount of information that can be exchanged between the radars and the coordinator. Importantly, each part of the network acts as an online learner, observing the environment to inform future actions. We show that in interference-limited spectrum, where the signal-to-interference-plus-noise ratio varies by channel and over time for a target with fixed radar cross section, a cognitive radar network is able to use information from the central coordinator in order to reduce the amount of time necessary to learn the optimal channel selection. We also show that even limited use of a central coordinator can eliminate collisions, which occur when two nodes select the same channel. △ Less

Submitted 22 April, 2023; v1 submitted 28 January, 2023; originally announced January 2023.

Comments: 34 pages, single-column, 10 figures

Online Learning-based Waveform Selection for Improved Vehicle Recognition in Automotive Radar

Authors: Charles E. Thornton, William W. Howard, R. Michael Buehrer

Abstract: This paper describes important considerations and challenges associated with online reinforcement-learning based waveform selection for target identification in frequency modulated continuous wave (FMCW) automotive radar systems. We present a novel learning approach based on satisficing Thompson sampling, which quickly identifies a waveform expected to yield satisfactory classification performance… ▽ More This paper describes important considerations and challenges associated with online reinforcement-learning based waveform selection for target identification in frequency modulated continuous wave (FMCW) automotive radar systems. We present a novel learning approach based on satisficing Thompson sampling, which quickly identifies a waveform expected to yield satisfactory classification performance. We demonstrate through measurement-level simulations that effective waveform selection strategies can be quickly learned, even in cases where the radar must select from a large catalog of candidate waveforms. The radar learns to adaptively select a bandwidth for appropriate resolution and a slow-time unimodular code for interference mitigation in the scene of interest by optimizing an expected classification metric. △ Less

Submitted 1 December, 2022; originally announced December 2022.

Comments: 5 pages, 3 figures

When is Cognitive Radar Beneficial?

Authors: Charles E. Thornton, R. Michael Buehrer

Abstract: When should an online reinforcement learning-based frequency agile cognitive radar be expected to outperform a rule-based adaptive waveform selection strategy? We seek insight regarding this question by examining a dynamic spectrum access scenario, in which the radar wishes to transmit in the widest unoccupied bandwidth during each pulse repetition interval. Online learning is compared to a fixed… ▽ More When should an online reinforcement learning-based frequency agile cognitive radar be expected to outperform a rule-based adaptive waveform selection strategy? We seek insight regarding this question by examining a dynamic spectrum access scenario, in which the radar wishes to transmit in the widest unoccupied bandwidth during each pulse repetition interval. Online learning is compared to a fixed rule-based sense-and-avoid strategy. We show that given a simple Markov channel model, the problem can be examined analytically for simple cases via stochastic dominance. Additionally, we show that for more realistic channel assumptions, learning-based approaches demonstrate greater ability to generalize. However, for short time-horizon problems that are well-specified, we find that machine learning approaches may perform poorly due to the inherent limitation of convergence time. We draw conclusions as to when learning-based approaches are expected to be beneficial and provide guidelines for future study. △ Less

Submitted 1 December, 2022; originally announced December 2022.

Comments: 6 pages, 5 figures

Timely Target Tracking in Cognitive Radar Networks

Authors: William W. Howard, Charles E. Thornton, R. Michael Buehrer

Abstract: We consider a scenario where a fusion center must decide which updates to receive during each update period in a communication-limited cognitive radar network. When each radar node in the network only is able to obtain noisy state measurements for a subset of the targets, the fusion center may not receive updates on every target during each update period. The solution for the selection problem at… ▽ More We consider a scenario where a fusion center must decide which updates to receive during each update period in a communication-limited cognitive radar network. When each radar node in the network only is able to obtain noisy state measurements for a subset of the targets, the fusion center may not receive updates on every target during each update period. The solution for the selection problem at the fusion center is not well suited for sequential learning frameworks. We derive an Age of Information-inspired track sensitive metric to inform node selection in such a network and compare it against less-informed techniques. △ Less

Submitted 14 February, 2023; v1 submitted 21 November, 2022; originally announced November 2022.

Comments: 6 pages, 6 figures. Presented at IEEE RadarConf 2023

RIS-Aided Localization under Position and Orientation Offsets in the Near and Far Field

Authors: Don-Roberts Emenonye, Harpreet S. Dhillon, R. Michael Buehrer

Abstract: This paper presents a rigorous Bayesian analysis of the information in the signal (consisting of both the line-of-sight (LOS) path and reflections from multiple reconfigurable intelligent surfaces (RISs)) that originate from a single base station (BS) and is received by a user equipment (UE). For a comprehensive Bayesian analysis, both near and far field regimes are considered. The Bayesian analys… ▽ More This paper presents a rigorous Bayesian analysis of the information in the signal (consisting of both the line-of-sight (LOS) path and reflections from multiple reconfigurable intelligent surfaces (RISs)) that originate from a single base station (BS) and is received by a user equipment (UE). For a comprehensive Bayesian analysis, both near and far field regimes are considered. The Bayesian analysis views both the location of the RISs and previous information about the UE as {\em a priori} information for UE localization. With outdated {\em a priori} information, the position and orientation offsets of the RISs become parameters that need to be estimated and fed back to the BS for correction. We first show that when the RIS elements have a half wavelength spacing, this RIS orientation offset is a factor in the pathloss of the RIS paths. Subsequently, we show through the Bayesian equivalent Fisher information matrix (EFIM) for the channel parameters that the RIS orientation offset cannot be corrected when there is an unknown phase offset in the received signal in the far-field regime. However, the corresponding EFIM for the channel parameters in the received signal observed in the near-field shows that this unknown phase offset does not hinder the estimation of the RIS orientation offset when the UE has more than one receive antenna. Furthermore, we use the EFIM for the UE location parameters to present bounds for UE localization in the presence of RIS uncertainty. △ Less

Submitted 21 August, 2023; v1 submitted 7 October, 2022; originally announced October 2022.

Model Order Estimation in the Presence of multipath Interference using Residual Convolutional Neural Networks

Authors: Jianyuan Yu, William W. Howard, Yue Xu, R. Michael Buehrer

Abstract: Model order estimation (MOE) is often a pre-requisite for Direction of Arrival (DoA) estimation. Due to limits imposed by array geometry, it is typically not possible to estimate spatial parameters for an arbitrary number of sources; an estimate of the signal model is usually required. MOE is the process of selecting the most likely signal model from several candidates. While classic methods fail… ▽ More Model order estimation (MOE) is often a pre-requisite for Direction of Arrival (DoA) estimation. Due to limits imposed by array geometry, it is typically not possible to estimate spatial parameters for an arbitrary number of sources; an estimate of the signal model is usually required. MOE is the process of selecting the most likely signal model from several candidates. While classic methods fail at MOE in the presence of coherent multipath interference, data-driven supervised learning models can solve this problem. Instead of the classic MLP (Multiple Layer Perceptions) or CNN (Convolutional Neural Networks) architectures, we propose the application of Residual Convolutional Neural Networks (RCNN), with grouped symmetric kernel filters to deliver state-of-art estimation accuracy of up to 95.2\% in the presence of coherent multipath, and a weighted loss function to eliminate underestimation error of the model order. We show the benefit of the approach by demonstrating its impact on an overall signal processing flow that determines the number of total signals received by the array, the number of independent sources, and the association of each of the paths with those sources . Moreover, we show that the proposed estimator provides accurate performance over a variety of array types, can identify the overloaded scenario, and ultimately provides strong DoA estimation and signal association performance. △ Less

Submitted 1 September, 2022; originally announced September 2022.

Coherent Time-Domain Canceling of Interference for Radio Astronomy

Authors: S. W. Ellingson, R. M. Buehrer

Abstract: Radio astronomy is vulnerable to interference from a variety of anthropogenic sources. Among the many strategies for mitigation of this interference is coherent time-domain canceling (CTC), which ideally allows one to "look through" interference, as opposed to avoiding the interference or deleting the afflicted data. However, CTC is difficult to implement, not well understood, and at present this… ▽ More Radio astronomy is vulnerable to interference from a variety of anthropogenic sources. Among the many strategies for mitigation of this interference is coherent time-domain canceling (CTC), which ideally allows one to "look through" interference, as opposed to avoiding the interference or deleting the afflicted data. However, CTC is difficult to implement, not well understood, and at present this strategy is not in regular use at any major radio telescope. This paper presents a review of CTC including a new comprehensive study of the capabilities and limitations of CTC using metrics relevant to radio astronomy, including fraction of interference power removed and increase in noise. This work is motivated by the emergence of a new generation of communications systems which pose a significantly increased threat to radio astronomy and which may overwhelm mitigation methods now in place. △ Less

Submitted 23 October, 2022; v1 submitted 8 August, 2022; originally announced August 2022.

Comments: Accepted Publ. Astron. Soc. Pac. Added appendices addressing a real-world example and impact of non-stationarity. Various other minor changes

Decentralized Bandits with Feedback for Cognitive Radar Networks

Authors: William Howard, R. Michael Buehrer

Abstract: Completely decentralized Multi-Player Bandit models have demonstrated high localization accuracy at the cost of long convergence times in cognitive radar networks. Rather than model each radar node as an independent learner, entirely unable to swap information with other nodes in a network, in this work we construct a "central coordinator" to facilitate the exchange of information between radar no… ▽ More Completely decentralized Multi-Player Bandit models have demonstrated high localization accuracy at the cost of long convergence times in cognitive radar networks. Rather than model each radar node as an independent learner, entirely unable to swap information with other nodes in a network, in this work we construct a "central coordinator" to facilitate the exchange of information between radar nodes. We show that in interference-limited spectrum, where the signal to interference plus noise (SINR) ratio for the available bands may vary by location, a cognitive radar network (CRN) is able to use information from a central coordinator to reduce the number of time steps required to attain a given localization error. Importantly, each node is still able to learn separately. We provide a description of a network which has hybrid cognition in both a central coordinator and in each of the cognitive radar nodes, and examine the online machine learning algorithms which can be implemented in this structure. △ Less

Submitted 20 July, 2022; originally announced July 2022.

Comments: 6 pages, 4 figures

Online Bayesian Meta-Learning for Cognitive Tracking Radar

Authors: Charles E. Thornton, R. Michael Buehrer, Anthony F. Martone

Abstract: A key component of cognitive radar is the ability to generalize, or achieve consistent performance across a range of sensing environments, since aspects of the physical scene may vary over time. This presents a challenge for learning-based waveform selection approaches, since transmission policies which are effective in one scene may be highly suboptimal in another. We address this problem by stra… ▽ More A key component of cognitive radar is the ability to generalize, or achieve consistent performance across a range of sensing environments, since aspects of the physical scene may vary over time. This presents a challenge for learning-based waveform selection approaches, since transmission policies which are effective in one scene may be highly suboptimal in another. We address this problem by strategically biasing a learning algorithm by exploiting high-level structure across tracking instances, referred to as meta-learning. In this work, we develop an online meta-learning approach for waveform-agile tracking. This approach uses information gained from previous target tracks to speed up and enhance learning in new tracking instances. This results in sample-efficient learning across a class of finite state target channels by exploiting inherent similarity across tracking scenes, attributed to common physical elements such as target type or clutter statistics. We formulate the online waveform selection problem within the framework of Bayesian learning, and provide prior-dependent performance bounds for the meta-learning problem using Probability Approximately Correct (PAC)-Bayes theory. We present a computationally feasible meta-posterior sampling algorithm and study the performance in a simulation study consisting of diverse scenes. Finally, we examine the potential performance benefits and practical challenges associated with online meta-learning for waveform-agile tracking. △ Less

Submitted 7 February, 2023; v1 submitted 7 July, 2022; originally announced July 2022.

Comments: 14 pages, 5 figures

Linear Jamming Bandits: Sample-Efficient Learning for Non-Coherent Digital Jamming

Authors: Charles E. Thornton, R. Michael Buehrer

Abstract: It has been shown (Amuru et al. 2015) that online learning algorithms can be effectively used to select optimal physical layer parameters for jamming against digital modulation schemes without a priori knowledge of the victim's transmission strategy. However, this learning problem involves solving a multi-armed bandit problem with a mixed action space that can grow very large. As a result, converg… ▽ More It has been shown (Amuru et al. 2015) that online learning algorithms can be effectively used to select optimal physical layer parameters for jamming against digital modulation schemes without a priori knowledge of the victim's transmission strategy. However, this learning problem involves solving a multi-armed bandit problem with a mixed action space that can grow very large. As a result, convergence to the optimal jamming strategy can be slow, especially when the victim and jammer's symbols are not perfectly synchronized. In this work, we remedy the sample efficiency issues by introducing a linear bandit algorithm that accounts for inherent similarities between actions. Further, we propose context features which are well-suited for the statistical features of the non-coherent jamming problem and demonstrate significantly improved convergence behavior compared to the prior art. Additionally, we show how prior knowledge about the victim's transmissions can be seamlessly integrated into the learning framework. We finally discuss limitations in the asymptotic regime. △ Less

Submitted 5 July, 2022; originally announced July 2022.

Comments: 6 pages, 7 figures

Fundamentals of RIS-Aided Localization in the Far-Field

Authors: Don-Roberts Emenonye, Harpreet S. Dhillon, R. Michael Buehrer

Abstract: This paper develops fundamental bounds for localization in orthogonal frequency division multiplexing (OFDM) systems aided by reconfigurable intelligent surfaces (RISs). Specifically, we start from the assumption that the position and orientation of a RIS can be viewed as prior information for RIS-aided localization in wireless systems and derive Bayesian bounds for the localization of a user equi… ▽ More This paper develops fundamental bounds for localization in orthogonal frequency division multiplexing (OFDM) systems aided by reconfigurable intelligent surfaces (RISs). Specifically, we start from the assumption that the position and orientation of a RIS can be viewed as prior information for RIS-aided localization in wireless systems and derive Bayesian bounds for the localization of a user equipment (UE). To do this, we first derive the Bayesian Fisher information matrix (FIM) for channel parameters to derive the Bayesian localization bounds. Then, to focus on the geometric channel parameters, we derive the equivalent Fisher information matrix (EFIM) and show that it has a definite structure. Subsequently, we show through the information loss associated with the EFIM that when the RIS reflection coefficients remain constant across all OFDM symbols, and there is no prior information about the nuisance parameters, the corresponding submatrix in the EFIM related to the RIS angle parameters is a zero matrix. As a result of the EFIM being a zero matrix, estimating the RIS-related angle channel parameters is not possible when the RIS reflection coefficients remain constant across all OFDM symbols. This observation is crucial for the estimation of the RIS-related angle parameters. It dictates that to estimate the RIS-related angle parameters, there must be more than one OFDM transmission with differing RIS reflection coefficients. △ Less

Submitted 21 August, 2023; v1 submitted 3 June, 2022; originally announced June 2022.

Distributed Online Learning for Coexistence in Cognitive Radar Networks

Authors: William Howard, Anthony Martone, R. Michael Buehrer

Abstract: This work addresses the coexistence problem for radar networks. Specifically, we model a network of cooperative, independent, and non-communicating radar nodes which must share resources within the network as well as with non-cooperative nearby emitters. We approach this problem using online Machine Learning (ML) techniques. Online learning approaches are specifically preferred due to the fact tha… ▽ More This work addresses the coexistence problem for radar networks. Specifically, we model a network of cooperative, independent, and non-communicating radar nodes which must share resources within the network as well as with non-cooperative nearby emitters. We approach this problem using online Machine Learning (ML) techniques. Online learning approaches are specifically preferred due to the fact that each radar node has no prior knowledge of the environment nor of the positions of the other radar nodes, and due to the sequential nature of the problem. For this task we specifically select the multi-player multi-armed bandit (MMAB) model, which poses the problem as a sequential game, where each radar node in a network makes independent selections of center frequency and waveform with the same goal of improving tracking performance for the network as a whole. For accurate tracking, each radar node communicates observations to a fusion center on set intervals. The fusion center has knowledge of the radar node placement, but cannot communicate to the individual nodes fast enough for waveform control. Every radar node in the network must learn the behavior of the environment, which includes rewards, interferer behavior, and target behavior. Our contributions include a mathematical description of the MMAB framework adapted to the radar network scenario. We conclude with a simulation study of several different network configurations. Experimental results show that iterative, online learning using MMAB outperforms the more traditional sense-and-avoid (SAA) and fixed-allocation approaches. △ Less

Submitted 20 July, 2022; v1 submitted 4 March, 2022; originally announced March 2022.

Comments: 14 pages, 10 figures

Weight Selection for Pattern Control of Paraboloidal Reflector Antennas with Reconfigurable Rim Scattering

Authors: R. Michael Buehrer, Steve W. Ellingson

Abstract: It has been recently demonstrated that modifying the rim scattering of a paraboloidal reflector antenna through the use of reconfigurable elements along the rim facilitates sidelobe modification including cancelling sidelobes. In this work we investigate techniques for determining the unit-magnitude weights (i.e., weights which modify the phase of the scattered signals) to accomplish sidelobe canc… ▽ More It has been recently demonstrated that modifying the rim scattering of a paraboloidal reflector antenna through the use of reconfigurable elements along the rim facilitates sidelobe modification including cancelling sidelobes. In this work we investigate techniques for determining the unit-magnitude weights (i.e., weights which modify the phase of the scattered signals) to accomplish sidelobe cancellation at arbitrary angles from the reflector axis. Specifically, it is shown that despite the large search space and the non-convexity of the cost function, weights can be found with reasonable complexity which provide significant cancellation capability. First, the optimal weights without any magnitude constraints are found. Afterwards, algorithms are developed for determining the unit-modulus weights with both quantized and unquantized phases. Further, it is shown that weights can be obtained that both cancel sidelobes while providing a constant main lobe gain. A primary finding is that sufficiently deep nulls are possible with essentially no change in the main lobe with practical (binary or quaternary) phase-only weights. △ Less

Submitted 26 February, 2022; originally announced February 2022.

Universal Learning Waveform Selection Strategies for Adaptive Target Tracking

Authors: Charles E. Thornton, R. Michael Buehrer, Harpreet S. Dhillon, Anthony F. Martone

Abstract: Online selection of optimal waveforms for target tracking with active sensors has long been a problem of interest. Many conventional solutions utilize an estimation-theoretic interpretation, in which a waveform-specific Cramér-Rao lower bound on measurement error is used to select the optimal waveform for each tracking step. However, this approach is only valid in the high SNR regime, and requires… ▽ More Online selection of optimal waveforms for target tracking with active sensors has long been a problem of interest. Many conventional solutions utilize an estimation-theoretic interpretation, in which a waveform-specific Cramér-Rao lower bound on measurement error is used to select the optimal waveform for each tracking step. However, this approach is only valid in the high SNR regime, and requires a rather restrictive set of assumptions regarding the target motion and measurement models. Further, due to computational concerns, many traditional approaches are limited to near-term, or myopic, optimization, even though radar scenes exhibit strong temporal correlation. More recently, reinforcement learning has been proposed for waveform selection, in which the problem is framed as a Markov decision process (MDP), allowing for long-term planning. However, a major limitation of reinforcement learning is that the memory length of the underlying Markov process is often unknown for realistic target and channel dynamics, and a more general framework is desirable. This work develops a universal sequential waveform selection scheme which asymptotically achieves Bellman optimality in any radar scene which can be modeled as a $U^{\text{th}}$ order Markov process for a finite, but unknown, integer $U$. Our approach is based on well-established tools from the field of universal source coding, where a stationary source is parsed into variable length phrases in order to build a context-tree, which is used as a probabalistic model for the scene's behavior. We show that an algorithm based on a multi-alphabet version of the Context-Tree Weighting (CTW) method can be used to optimally solve a broad class of waveform-agile tracking problems while making minimal assumptions about the environment's behavior. △ Less

Submitted 10 February, 2022; originally announced February 2022.

Comments: 23 pages, 5 figures

Multi-Band Wi-Fi Sensing with Matched Feature Granularity

Authors: Jianyuan Yu, Pu, Wang, Toshiaki Koike-Akino, Ye Wang, Philip V. Orlik, R. Michael Buehrer

Abstract: Complementary to the fine-grained channel state information (CSI) from the physical layer and coarse-grained received signal strength indicator (RSSI) measurements, the mid-grained spatial beam attributes (e.g., beam SNR) that are available at millimeter-wave (mmWave) bands during the mandatory beam training phase can be repurposed for Wi-Fi sensing applications. In this paper, we propose a multi-… ▽ More Complementary to the fine-grained channel state information (CSI) from the physical layer and coarse-grained received signal strength indicator (RSSI) measurements, the mid-grained spatial beam attributes (e.g., beam SNR) that are available at millimeter-wave (mmWave) bands during the mandatory beam training phase can be repurposed for Wi-Fi sensing applications. In this paper, we propose a multi-band Wi-Fi fusion method for Wi-Fi sensing that hierarchically fuses the features from both the fine-grained CSI at sub-6 GHz and the mid-grained beam SNR at 60 GHz in a granularity matching framework. The granularity matching is realized by pairing two feature maps from the CSI and beam SNR at different granularity levels and linearly combining all paired feature maps into a fused feature map with learnable weights. To further address the issue of limited labeled training data, we propose an autoencoder-based multi-band Wi-Fi fusion network that can be pre-trained in an unsupervised fashion. Once the autoencoder-based fusion network is pre-trained, we detach the decoders and append multi-task sensing heads to the fused feature map by fine-tuning the fusion block and re-training the multi-task heads from the scratch. The multi-band Wi-Fi fusion framework is thoroughly validated by in-house experimental Wi-Fi sensing datasets spanning three tasks: 1) pose recognition; 2) occupancy sensing; and 3) indoor localization. Comparison to four baseline methods (i.e., CSI-only, beam SNR-only, input fusion, and feature fusion) demonstrates the granularity matching improves the multi-task sensing performance. Quantitative performance is evaluated as a function of the number of labeled training data, latent space dimension, and fine-tuning learning rates. △ Less

Submitted 6 February, 2022; v1 submitted 28 December, 2021; originally announced December 2021.

Comments: 12 pages, 14 figures

Differential Modulation in Massive MIMO With Low-Resolution ADCs

Authors: Don-Roberts Emenonye, Carl Dietrich, R. Michael Buehrer

Abstract: In this paper, we present a differential modulation and detection scheme for use in the uplink of a system with a large number of antennas at the base station, each equipped with low-resolution analog-to-digital converters (ADCs). We derive an expression for the maximum likelihood (ML) detector of a differentially encoded phase information symbol received by a base station operating in the low-res… ▽ More In this paper, we present a differential modulation and detection scheme for use in the uplink of a system with a large number of antennas at the base station, each equipped with low-resolution analog-to-digital converters (ADCs). We derive an expression for the maximum likelihood (ML) detector of a differentially encoded phase information symbol received by a base station operating in the low-resolution ADC regime. We also present an equal performing reduced complexity receiver for detecting the phase information. To increase the supported data rate, we also present a maximum likelihood expression to detect differential amplitude phase shift keying symbols with low-resolution ADCs. We note that the derived detectors are unable to detect the amplitude information. To overcome this limitation, we use the Bussgang Theorem and the Central Limit Theorem (CLT) to develop two detectors capable of detecting the amplitude information. We numerically show that while the first amplitude detector requires multiple quantization bits for acceptable performance, similar performance can be achieved using one-bit ADCs by grou** the receive antennas and employing variable quantization levels (VQL) across distinct antenna groups. We validate the performance of the proposed detectors through simulations and show a comparison with corresponding coherent detectors. Finally, we present a complexity analysis of the proposed low-resolution differential detectors △ Less

Submitted 2 December, 2021; v1 submitted 9 November, 2021; originally announced November 2021.

Differential Deep Detection in Massive MIMO With One-Bit ADC

Authors: Don-Roberts Emenonye, Carl Dietrich, R. Michael Buehrer

Abstract: This article presents a differential detection scheme for the uplink of a massive MIMO system that employs one-bit quantizers on each receive antenna. We focus on the detection of differential amplitude and phase shift keying symbols and we use the Bussgang theorem to express the quantized received signal in terms of quantized signals received during previous channel uses. Subsequently, we derive… ▽ More This article presents a differential detection scheme for the uplink of a massive MIMO system that employs one-bit quantizers on each receive antenna. We focus on the detection of differential amplitude and phase shift keying symbols and we use the Bussgang theorem to express the quantized received signal in terms of quantized signals received during previous channel uses. Subsequently, we derive the maximum likelihood detector for the differentially encoded amplitude and phase information symbols. We note that while the one-bit detector can decode the differentially encoded phase information symbols, it fails to decode the differentially encoded amplitude information. To decode the amplitude information, we present a one-bit variable quantization level (VQL) system and train a deep neural network to perform two-symbol differential amplitude detection. Through Monte-Carlo simulations, we empirically validate the performance of the proposed amplitude and phase detectors. The presented numerical results show that the spectral efficiency attained in one-bit differential systems is better than the spectral efficiency attained in one-bit coherent systems △ Less

Submitted 27 October, 2021; originally announced October 2021.

Adversarial Multi-Player Bandits for Cognitive Radar Networks

Authors: William W. Howard, R. M. Buehrer, Anthony Martone

Abstract: We model a radar network as an adversarial bandit problem, where the environment pre-selects reward sequences for each of several actions available to the network. This excludes environments which vary rewards in response to the learner's actions. Adversarial environments include those with third party emitters which enter and exit the environment according to some criteria which does not depend o… ▽ More We model a radar network as an adversarial bandit problem, where the environment pre-selects reward sequences for each of several actions available to the network. This excludes environments which vary rewards in response to the learner's actions. Adversarial environments include those with third party emitters which enter and exit the environment according to some criteria which does not depend on the radar network. The network consists of several independent radar nodes, which attempt to attain the highest possible SINR in each of many time steps. We show that in such an environment, simple sub-band selection algorithms are unable to consistently attain high SINR. However, through the use of adversarial multi-player bandit algorithms, a radar network can continue to track targets without a loss in tracking precision. △ Less

Submitted 22 October, 2021; originally announced October 2021.

Comments: 6 pages, 5 figures. Submitted to IEEE Radar Conference 2022, NYC

Online Meta-Learning for Scene-Diverse Waveform-Agile Radar Target Tracking

Authors: Charles E. Thornton, R. Michael Buehrer, Anthony F. Martone

Abstract: A fundamental problem for waveform-agile radar systems is that the true environment is unknown, and transmission policies which perform well for a particular tracking instance may be sub-optimal for another. Additionally, there is a limited time window for each target track, and the radar must learn an effective strategy from a sequence of measurements in a timely manner. This paper studies a Baye… ▽ More A fundamental problem for waveform-agile radar systems is that the true environment is unknown, and transmission policies which perform well for a particular tracking instance may be sub-optimal for another. Additionally, there is a limited time window for each target track, and the radar must learn an effective strategy from a sequence of measurements in a timely manner. This paper studies a Bayesian meta-learning model for radar waveform selection which seeks to learn an inductive bias to quickly optimize tracking performance across a class of radar scenes. We cast the waveform selection problem in the framework of sequential Bayesian inference, and introduce a contextual bandit variant of the recently proposed meta-Thompson Sampling algorithm, which learns an inductive bias in the form of a prior distribution. Each track is treated as an instance of a contextual bandit learning problem, coming from a task distribution. We show that the meta-learning process results in an appreciably faster learning, resulting in significantly fewer lost tracks than a conventional learning approach equipped with an uninformative prior. △ Less

Submitted 21 October, 2021; originally announced October 2021.

Comments: 6 pages, 6 figures

Open-set Classification of Common Waveforms Using A Deep Feed-forward Network and Binary Isolation Forest Models

Authors: C. Tanner Fredieu, Anthony Martone, R. Michael Buehrer

Abstract: In this paper, we examine the use of a deep multi-layer perceptron architecture to classify received signals as one of seven common waveforms, single carrier (SC), single-carrier frequency division multiple access (SC-FDMA), orthogonal frequency division multiplexing (OFDM), linear frequency modulation (LFM), amplitude modulation (AM), frequency modulation (FM), and phase-coded pulse modulation us… ▽ More In this paper, we examine the use of a deep multi-layer perceptron architecture to classify received signals as one of seven common waveforms, single carrier (SC), single-carrier frequency division multiple access (SC-FDMA), orthogonal frequency division multiplexing (OFDM), linear frequency modulation (LFM), amplitude modulation (AM), frequency modulation (FM), and phase-coded pulse modulation used in communication and radar networks. Synchronization of the signals is not needed as we assume there is an unknown and uncompensated time and frequency offset. The classifier is open-set meaning it assumes unknown waveforms may appear. Isolation forest (IF) models acting as binary classifiers are used for each known signal class to perform detection of possible unknown signals. This is accomplished using the 32-length feature vector from a dense layer as input to the IF models. The classifier and IF models work together to monitor the spectrum and identify waveforms along with detecting unknown waveforms. Results showed the classifier had 100% classification rate above 0 dB with an accuracy of 83.2% and 94.7% at -10 dB and -5 dB, respectively, with signal impairments present. Results for the IF models showed an overall accuracy of 98% when detecting known and unknown signals with signal impairments present. IF models were able to reject all unknown signals while signals similar to known signals were able to pass through 2% of the time due to the contamination rate used during training. Overall, the entire system can classify correctly in an open-set mode with 98% accuracy at SNR greater than 0 dB. △ Less

Submitted 1 October, 2021; originally announced October 2021.

Comments: arXiv admin note: substantial text overlap with arXiv:2108.07339

Multi-Target Localization Using Polarization Sensitive Arrays

Authors: William W. Howard, R. Michael Buehrer

Abstract: In this work we develop clustering techniques for the Bearing Only Target Localization (BOTL) problem. Our scenario has a receiver move along some path, generating bearing estimates on some interval. Multiple emitting targets exist in the environment, and may be physically close with respect to the receiver distance. The first method is iterative and uses only a series of observed bearings to mult… ▽ More In this work we develop clustering techniques for the Bearing Only Target Localization (BOTL) problem. Our scenario has a receiver move along some path, generating bearing estimates on some interval. Multiple emitting targets exist in the environment, and may be physically close with respect to the receiver distance. The first method is iterative and uses only a series of observed bearings to multiple targets to establish clusters. In each iteration, target positions are estimated using a nonlinear least squares solution. The second technique uses additional polarization information, and is shown to be more effective while requiring more information. In addition the second technique is non-iterative and requires far less computation. In this work we presume knowledge of the number of targets. We conclude by providing simulations of our method and show that the proposed approach outperforms previously proposed methods. △ Less

Submitted 8 October, 2021; v1 submitted 18 August, 2021; originally announced August 2021.

Comments: 5 pages, 6 figures, accepted to IEEE MILCOM 2021

Classification of Common Waveforms Including a Watchdog for Unknown Signals

Authors: C. Tanner Fredieu, Justin Bui, Anthony Martone, Robert J. Marks II, Charles Baylis, R. Michael Buehrer

Abstract: In this paper, we examine the use of a deep multi-layer perceptron model architecture to classify received signal samples as coming from one of four common waveforms, Single Carrier (SC), Single-Carrier Frequency Division Multiple Access (SC-FDMA), Orthogonal Frequency Division Multiplexing (OFDM), and Linear Frequency Modulation (LFM), used in communication and radar networks. Synchronization of… ▽ More In this paper, we examine the use of a deep multi-layer perceptron model architecture to classify received signal samples as coming from one of four common waveforms, Single Carrier (SC), Single-Carrier Frequency Division Multiple Access (SC-FDMA), Orthogonal Frequency Division Multiplexing (OFDM), and Linear Frequency Modulation (LFM), used in communication and radar networks. Synchronization of the signals is not needed as we assume there is an unknown and uncompensated time and frequency offset. An autoencoder with a deep CNN architecture is also examined to create a new fifth classification category of an unknown waveform type. This is accomplished by calculating a minimum and maximum threshold values from the root mean square error (RMSE) of the radar and communication waveforms. The classifier and autoencoder work together to monitor a spectrum area to identify the common waveforms inside the area of operation along with detecting unknown waveforms. Results from testing showed the classifier had 100\% classification rate above 0 dB with accuracy of 83.2\% and 94.7\% at -10 dB and -5 dB, respectively, with signal impairments present. Results for the anomaly detector showed 85.3\% accuracy at 0 dB with 100\% at SNR greater than 0 dB with signal impairments present when using a high-value Fast Fourier Transform (FFT) size. Accurate detection rates decline as additional noise is introduced to the signals, with 78.1\% at -5 dB and 56.5\% at -10 dB. However, these low rates seen can be potentially mitigated by using even higher FFT sizes also shown in our results. △ Less

Submitted 16 August, 2021; originally announced August 2021.

Open Set Wireless Standard Classification Using Convolutional Neural Networks

Authors: Samuel R. Shebert, Anthony F. Martone, R. Michael Buehrer

Abstract: In congested electromagnetic environments, cognitive radios require knowledge about other emitters in order to optimize their dynamic spectrum access strategy. Deep learning classification algorithms have been used to recognize the wireless signal standards of emitters with high accuracy, but are limited to classifying signal classes that appear in their training set. This diminishes the performan… ▽ More In congested electromagnetic environments, cognitive radios require knowledge about other emitters in order to optimize their dynamic spectrum access strategy. Deep learning classification algorithms have been used to recognize the wireless signal standards of emitters with high accuracy, but are limited to classifying signal classes that appear in their training set. This diminishes the performance of deep learning classifiers deployed in the field because they cannot accurately identify signals from classes outside of the training set. In this paper, a convolution neural network based open set classifier is proposed with the ability to detect if signals are not from known classes by thresholding the output sigmoid activation. The open set classifier was trained on 4G LTE, 5G NR, IEEE 802.11ax, Bluetooth Low Energy 5.0, and Narrowband Internet-of-Things signals impaired with Rayleigh or Rician fading, AWGN, frequency offsets, and in-phase/quadrature imbalances. Then, the classifier was tested on OFDM, SC-FDMA, SC, AM, and FM signals, which did not appear in the training set classes. The closed set classifier achieves an average accuracy of 94.5% for known signals with SNR's greater than 0 dB, but by design, has a 0% accuracy detecting signals from unknown classes. On the other hand, the open set classifier retains an 86% accuracy for known signal classes, but can detect 95.5% of signals from unknown classes with SNR's greater than 0 dB. △ Less

Submitted 3 August, 2021; originally announced August 2021.

Waveform Selection for Radar Tracking in Target Channels With Memory via Universal Learning

Authors: Charles E. Thornton, R. Michael Buehrer, Anthony F. Martone

Abstract: In tracking radar, the sensing environment often varies significantly over a track duration due to the target's trajectory and dynamic interference. Adapting the radar's waveform using partial information about the state of the scene has been shown to provide performance benefits in many practical scenarios. Moreover, radar measurements generally exhibit strong temporal correlation, allowing memor… ▽ More In tracking radar, the sensing environment often varies significantly over a track duration due to the target's trajectory and dynamic interference. Adapting the radar's waveform using partial information about the state of the scene has been shown to provide performance benefits in many practical scenarios. Moreover, radar measurements generally exhibit strong temporal correlation, allowing memory-based learning algorithms to effectively learn waveform selection strategies. This work examines a radar system which builds a compressed model of the radar-environment interface in the form of a context-tree. The radar uses this context tree-based model to select waveforms in a signal-dependent target channel, which may respond adversarially to the radar's strategy. This approach is guaranteed to asymptotically converge to the average-cost optimal policy for any stationary target channel that can be represented as a Markov process of order U < $\infty$, where the constant U is unknown to the radar. The proposed approach is tested in a simulation study, and is shown to provide tracking performance improvements over two state-of-the-art waveform selection schemes. △ Less

Submitted 2 August, 2021; originally announced August 2021.

Comments: 6 pages, 2 figures

Constrained Contextual Bandit Learning for Adaptive Radar Waveform Selection

Authors: Charles E. Thornton, R. Michael Buehrer, Anthony F. Martone

Abstract: A sequential decision process in which an adaptive radar system repeatedly interacts with a finite-state target channel is studied. The radar is capable of passively sensing the spectrum at regular intervals, which provides side information for the waveform selection process. The radar transmitter uses the sequence of spectrum observations as well as feedback from a collocated receiver to select w… ▽ More A sequential decision process in which an adaptive radar system repeatedly interacts with a finite-state target channel is studied. The radar is capable of passively sensing the spectrum at regular intervals, which provides side information for the waveform selection process. The radar transmitter uses the sequence of spectrum observations as well as feedback from a collocated receiver to select waveforms which accurately estimate target parameters. It is shown that the waveform selection problem can be effectively addressed using a linear contextual bandit formulation in a manner that is both computationally feasible and sample efficient. Stochastic and adversarial linear contextual bandit models are introduced, allowing the radar to achieve effective performance in broad classes of physical environments. Simulations in a radar-communication coexistence scenario, as well as in an adversarial radar-jammer scenario, demonstrate that the proposed formulation provides a substantial improvement in target detection performance when Thompson Sampling and EXP3 algorithms are used to drive the waveform selection process. Further, it is shown that the harmful impacts of pulse-agile behavior on coherently processed radar data can be mitigated by adopting a time-varying constraint on the radar's waveform catalog. △ Less

Submitted 14 June, 2021; v1 submitted 9 March, 2021; originally announced March 2021.

Comments: 16 pages, 9 figures. arXiv admin note: text overlap with arXiv:2010.15698

Journal ref: IEEE Transactions on Aerospace and Electronic Systems, 2021

Multi-player Bandits for Distributed Cognitive Radar

Authors: William W. Howard, Charles E. Thornton, Anthony F. Martone, R. Michael Buehrer

Abstract: With new applications for radar networks such as automotive control or indoor localization, the need for spectrum sharing and general interoperability is expected to rise. This paper describes the application of multi-player bandit algorithms for waveform selection to a distributed cognitive radar network that must coexist with a communications system. Specifically, we make the assumption that rad… ▽ More With new applications for radar networks such as automotive control or indoor localization, the need for spectrum sharing and general interoperability is expected to rise. This paper describes the application of multi-player bandit algorithms for waveform selection to a distributed cognitive radar network that must coexist with a communications system. Specifically, we make the assumption that radar nodes in the network have no dedicated communication channel. As we will discuss later, nodes can communicate indirectly by taking actions which intentionally interfere with other nodes and observing the resulting collisions. The radar nodes attempt to optimize their own spectrum utilization while avoiding collisions, not only with each other, but with the communications system. The communications system is assumed to statically occupy some subset of the bands available to the radar network. First, we examine models that assume each node experiences equivalent channel conditions, and later examine a model that relaxes this assumption. △ Less

Submitted 30 January, 2021; originally announced February 2021.

Comments: 6 pages, 2 figures, accepted to the 2021 IEEE Radar Conference

Constrained Online Learning to Mitigate Distortion Effects in Pulse-Agile Cognitive Radar

Authors: Charles E. Thornton, R. Michael Buehrer, Anthony F. Martone

Abstract: Pulse-agile radar systems have demonstrated favorable performance in dynamic electromagnetic scenarios. However, the use of non-identical waveforms within a radar's coherent processing interval may lead to harmful distortion effects when pulse-Doppler processing is used. This paper presents an online learning framework to optimize detection performance while mitigating harmful sidelobe levels. The… ▽ More Pulse-agile radar systems have demonstrated favorable performance in dynamic electromagnetic scenarios. However, the use of non-identical waveforms within a radar's coherent processing interval may lead to harmful distortion effects when pulse-Doppler processing is used. This paper presents an online learning framework to optimize detection performance while mitigating harmful sidelobe levels. The radar waveform selection process is formulated as a linear contextual bandit problem, within which waveform adaptations which exceed a tolerable level of expected distortion are eliminated. The constrained online learning approach is effective and computationally feasible, evidenced by simulations in a radar-communication coexistence scenario and in the presence of intentional adaptive jamming. This approach is applied to both stochastic and adversarial contextual bandit learning models and the detection performance in dynamic scenarios is evaluated. △ Less

Submitted 26 February, 2021; v1 submitted 29 October, 2020; originally announced October 2020.

Comments: 6 pages, 4 figures, to be presented at IEEE Radar Conference, Atlanta GA, May 2021

Characterizing the First-Arriving Multipath Component in 5G Millimeter Wave Networks: TOA, AOA, and Non-Line-of-Sight Bias

Authors: Christopher E. O'Lone, Harpreet S. Dhillon, R. Michael Buehrer

Abstract: This paper presents a stochastic geometry-based analysis of propagation statistics for 5G millimeter wave (mm-wave) cellular. In particular, the time-of-arrival (TOA) and angle-of-arrival (AOA) distributions of the first-arriving multipath component (MPC) are derived. These statistics find their utility in many applications such as cellular-based localization, channel modeling, and link establishm… ▽ More This paper presents a stochastic geometry-based analysis of propagation statistics for 5G millimeter wave (mm-wave) cellular. In particular, the time-of-arrival (TOA) and angle-of-arrival (AOA) distributions of the first-arriving multipath component (MPC) are derived. These statistics find their utility in many applications such as cellular-based localization, channel modeling, and link establishment for mm-wave initial access (IA). Leveraging tools from stochastic geometry, a Boolean model is used to statistically characterize the random locations, orientations, and sizes of reflectors, e.g., buildings. Assuming non-line-of-sight (NLOS) propagation is due to first-order (i.e., single-bounce) reflections, and that reflectors can either facilitate or block reflections, the distribution of the path length (i.e., absolute time delay) of the first-arriving MPC is derived. This result is then used to obtain the first NLOS bias distribution in the localization literature that is based on the absolute delay of the first-arriving MPC for outdoor time-of-flight (TOF) range measurements. This distribution is shown to match exceptionally well with commonly assumed gamma and exponential NLOS bias models in the literature, which were only attainted previously through heuristic or indirect methods. Continuing under this analytical framework, the AOA distribution of the first-arriving MPC is derived, which gives novel insight into how environmental obstacles affect the AOA and also represents the first AOA distribution derived under the Boolean Model. △ Less

Submitted 19 October, 2020; originally announced October 2020.

Comments: This arXiv manuscript subsumes the contents of the conference paper presented at the 2019 IEEE Global Communications Conference (Globecom), Waikoloa, HI. The conference version is available at arXiv:1905.00603v2

When is Enough Enough? "Just Enough" Decision Making with Recurrent Neural Networks for Radio Frequency Machine Learning

Authors: Megan Moore, William H. Clark IV, R. Michael Buehrer, William C. Headley

Abstract: Prior work has demonstrated that recurrent neural network architectures show promising improvements over other machine learning architectures when processing temporally correlated inputs, such as wireless communication signals. Additionally, recurrent neural networks typically process data on a sequential basis, enabling the potential for near real-time results. In this work, we investigate the no… ▽ More Prior work has demonstrated that recurrent neural network architectures show promising improvements over other machine learning architectures when processing temporally correlated inputs, such as wireless communication signals. Additionally, recurrent neural networks typically process data on a sequential basis, enabling the potential for near real-time results. In this work, we investigate the novel usage of "just enough" decision making metrics for making decisions during inference based on a variable number of input symbols. Since some signals are more complex than others, due to channel conditions, transmitter/receiver effects, etc., being able to dynamically utilize just enough of the received symbols to make a reliable decision allows for more efficient decision making in applications such as electronic warfare and dynamic spectrum sharing. To demonstrate the validity of this concept, four approaches to making "just enough" decisions are considered in this work and each are analyzed for their applicability to wireless communication machine learning applications. △ Less

Submitted 13 October, 2020; originally announced October 2020.

Comments: IEEE IPCCC 2020

The RFML Ecosystem: A Look at the Unique Challenges of Applying Deep Learning to Radio Frequency Applications

Authors: Lauren J. Wong, William H. Clark IV, Bryse Flowers, R. Michael Buehrer, Alan J. Michaels, William C. Headley

Abstract: While deep machine learning technologies are now pervasive in state-of-the-art image recognition and natural language processing applications, only in recent years have these technologies started to sufficiently mature in applications related to wireless communications. In particular, recent research has shown deep machine learning to be an enabling technology for cognitive radio applications as w… ▽ More While deep machine learning technologies are now pervasive in state-of-the-art image recognition and natural language processing applications, only in recent years have these technologies started to sufficiently mature in applications related to wireless communications. In particular, recent research has shown deep machine learning to be an enabling technology for cognitive radio applications as well as a useful tool for supplementing expertly defined algorithms for spectrum sensing applications such as signal detection, estimation, and classification (termed here as Radio Frequency Machine Learning, or RFML). A major driver for the usage of deep machine learning in the context of wireless communications is that little, to no, a priori knowledge of the intended spectral environment is required, given that there is an abundance of representative data to facilitate training and evaluation. However, in addition to this fundamental need for sufficient data, there are other key considerations, such as trust, security, and hardware/software issues, that must be taken into account before deploying deep machine learning systems in real-world wireless communication applications. This paper provides an overview and survey of prior work related to these major research considerations. In particular, we present their unique considerations in the RFML application space, which are not generally present in the image, audio, and/or text application spaces. △ Less

Submitted 1 October, 2020; originally announced October 2020.

Efficient Online Learning for Cognitive Radar-Cellular Coexistence via Contextual Thompson Sampling

Authors: Charles E. Thornton, R. Michael Buehrer, Anthony F. Martone

Abstract: This paper describes a sequential, or online, learning scheme for adaptive radar transmissions that facilitate spectrum sharing with a non-cooperative cellular network. First, the interference channel between the radar and a spatially distant cellular network is modeled. Then, a linear Contextual Bandit (CB) learning framework is applied to drive the radar's behavior. The fundamental trade-off bet… ▽ More This paper describes a sequential, or online, learning scheme for adaptive radar transmissions that facilitate spectrum sharing with a non-cooperative cellular network. First, the interference channel between the radar and a spatially distant cellular network is modeled. Then, a linear Contextual Bandit (CB) learning framework is applied to drive the radar's behavior. The fundamental trade-off between exploration and exploitation is balanced by a proposed Thompson Sampling (TS) algorithm, a pseudo-Bayesian approach which selects waveform parameters based on the posterior probability that a specific waveform is optimal, given discounted channel information as context. It is shown that the contextual TS approach converges more rapidly to behavior that minimizes mutual interference and maximizes spectrum utilization than comparable contextual bandit algorithms. Additionally, we show that the TS learning scheme results in a favorable SINR distribution compared to other online learning algorithms. Finally, the proposed TS algorithm is compared to a deep reinforcement learning model. We show that the TS algorithm maintains competitive performance with a more complex Deep Q-Network (DQN). △ Less

Submitted 23 August, 2020; originally announced August 2020.

Comments: 6 pages, 6 Figures, To Appear in Proc. IEEE GLOBECOM 2020, Taipei Taiwan

Predicting Bit Error Rate from Meta Information using Random Forests

Authors: Jianyuan Yu, Yue Xu, Hussein Metwaly Saad, R. Michael Buehrer

Abstract: With the increasing power of machine learning-based reasoning, the use of meta-information (e.g., digital signal modulation parameters, channel conditions, etc.) to predict the performance of various signal processing techniques has become feasible. One such problem of practical interest is choosing a proper interference mitigation method based on the meta information of the received signal. Since… ▽ More With the increasing power of machine learning-based reasoning, the use of meta-information (e.g., digital signal modulation parameters, channel conditions, etc.) to predict the performance of various signal processing techniques has become feasible. One such problem of practical interest is choosing a proper interference mitigation method based on the meta information of the received signal. Since heuristic table-based methods suffer from limited prediction capability for unseen cases, we propose a recommendation system based on the use of Random Forests (RF). Specifically, RF used to predict the Bit-Error-Rate (BER) of all mitigation approaches so as to determine the approach with the best performance. We found RF can predict BER with high accuracy, and its importance factor demonstrates which input attributes matter most. These BER prediction results can also benefit other functions such as adaptive modulation, channel sensing, beaming selection, etc. △ Less

Submitted 10 July, 2020; originally announced July 2020.

Deep Reinforcement Learning Control for Radar Detection and Tracking in Congested Spectral Environments

Authors: Charles E. Thornton, Mark A. Kozy, R. Michael Buehrer, Anthony F. Martone, Kelly D. Sherbondy

Abstract: In this paper, dynamic non-cooperative coexistence between a cognitive pulsed radar and a nearby communications system is addressed by applying nonlinear value function approximation via deep reinforcement learning (Deep RL) to develop a policy for optimal radar performance. The radar learns to vary the bandwidth and center frequency of its linear frequency modulated (LFM) waveforms to mitigate mu… ▽ More In this paper, dynamic non-cooperative coexistence between a cognitive pulsed radar and a nearby communications system is addressed by applying nonlinear value function approximation via deep reinforcement learning (Deep RL) to develop a policy for optimal radar performance. The radar learns to vary the bandwidth and center frequency of its linear frequency modulated (LFM) waveforms to mitigate mutual interference with other systems and improve target detection performance while also maintaining sufficient utilization of the available frequency bands required for a fine range resolution. We demonstrate that our approach, based on the Deep Q-Learning (DQL) algorithm, enhances important radar metrics, including SINR and bandwidth utilization, more effectively than policy iteration or sense-and-avoid (SAA) approaches in a variety of realistic coexistence environments. We also extend the DQL-based approach to incorporate Double Q-learning and a recurrent neural network to form a Double Deep Recurrent Q-Network (DDRQN). We demonstrate the DDRQN results in favorable performance and stability compared to DQL and policy iteration. Finally, we demonstrate the practicality of our proposed approach through a discussion of experiments performed on a software defined radar (SDRadar) prototype system. Our experimental results indicate that the proposed Deep RL approach significantly improves radar detection performance in congested spectral environments when compared to policy iteration and SAA. △ Less

Submitted 27 August, 2020; v1 submitted 23 June, 2020; originally announced June 2020.

Comments: To Appear in IEEE Transactions on Cognitive Communications and Networking, 2020

Direction of Arrival Estimation for a Vector Sensor Using Deep Neural Networks

Authors: Jianyuan Yu, William W. Howard, Daniel Tait, R. Michael Buehrer

Abstract: A vector sensor, a type of sensor array with six collocated antennas to measure all electromagnetic field components of incident waves, has been shown to be advantageous in estimating the angle of arrival and polarization of the incident sources. While angle estimation with machine learning for linear arrays has been well studied, there has not been a similar solution for the vector sensor. In thi… ▽ More A vector sensor, a type of sensor array with six collocated antennas to measure all electromagnetic field components of incident waves, has been shown to be advantageous in estimating the angle of arrival and polarization of the incident sources. While angle estimation with machine learning for linear arrays has been well studied, there has not been a similar solution for the vector sensor. In this paper, we propose neural networks to determine the number of the sources and estimate the angle of arrival of each source, based on the covariance matrix extracted from received data. Also, we provide a solution for matching output angles to corresponding sources and examine the error distributions with this method. The results show that neural networks can achieve reasonably accurate estimation with up to 5 sources, especially if the field-of-view is limited. △ Less

Submitted 12 April, 2020; originally announced April 2020.

Centimeter-Level Indoor Localization using Channel State Information with Recurrent Neural Networks

Authors: Jianyuan Yu, R. Michael Buehrer

Abstract: Modern techniques in the Internet of Things or autonomous driving require more accuracy positioning ever. Classic location techniques mainly adapt to outdoor scenarios, while they do not meet the requirement of indoor cases with multiple paths. Meanwhile as a feature robust to noise and time variations, Channel State Information (CSI) has shown its advantages over Received Signal Strength Indicato… ▽ More Modern techniques in the Internet of Things or autonomous driving require more accuracy positioning ever. Classic location techniques mainly adapt to outdoor scenarios, while they do not meet the requirement of indoor cases with multiple paths. Meanwhile as a feature robust to noise and time variations, Channel State Information (CSI) has shown its advantages over Received Signal Strength Indicator (RSSI) at more accurate positioning. To this end, this paper proposes the neural network method to estimate the centimeter-level indoor positioning with real CSI data collected from linear antennas. It utilizes an amplitude of channel response or a correlation matrix as the input, which can highly reduce the data size and suppress the noise. Also, it makes use of the consistency in the user motion trajectory via Recurrent Neural Network (RNN) and signal-noise ratio (SNR) information, which can further improve the estimation accuracy, especially in small datasize learning. These contributions all benefit the efficiency of the neural network, based on the results with other classic supervised learning methods. △ Less

Submitted 4 February, 2020; originally announced February 2020.

Interference Classification Using Deep Neural Networks

Authors: Jianyuan Yu, Mohammad Alhassoun, R. Michael Buehrer

Abstract: The recent success in implementing supervised learning to classify modulation types suggests that other problems akin to modulation classification would eventually benefit from that implementation. One of these problems is classifying the interference type added to a signal-of-interest, also known as interference classification. In this paper, we propose an interference classification method using… ▽ More The recent success in implementing supervised learning to classify modulation types suggests that other problems akin to modulation classification would eventually benefit from that implementation. One of these problems is classifying the interference type added to a signal-of-interest, also known as interference classification. In this paper, we propose an interference classification method using a deep neural network. We generate five distinct types of interfering signals then use both the power-spectral density (PSD) and the cyclic spectrum of the received signal as input features to the network. The computer experiments reveal that using the received signal PSD outperforms using its cyclic spectrum in terms of accuracy. In addition, the same experiments show that the feed-forward networks yield better accuracy than classic methods. The proposed classifier aids the subsequent stage in the receiver chain with choosing the appropriate mitigation algorithm and also can coexist with modulation-classification methods to further improve the classifier accuracy. △ Less

Submitted 6 April, 2020; v1 submitted 2 February, 2020; originally announced February 2020.

Comments: paper get rejected, need more editing

Experimental Analysis of Reinforcement Learning Techniques for Spectrum Sharing Radar

Authors: Charles E. Thornton, R. Michael Buehrer, Anthony F. Martone, Kelly D. Sherbondy

Abstract: In this work, we first describe a framework for the application of Reinforcement Learning (RL) control to a radar system that operates in a congested spectral setting. We then compare the utility of several RL algorithms through a discussion of experiments performed on Commercial off-the-shelf (COTS) hardware. Each RL technique is evaluated in terms of convergence, radar detection performance achi… ▽ More In this work, we first describe a framework for the application of Reinforcement Learning (RL) control to a radar system that operates in a congested spectral setting. We then compare the utility of several RL algorithms through a discussion of experiments performed on Commercial off-the-shelf (COTS) hardware. Each RL technique is evaluated in terms of convergence, radar detection performance achieved in a congested spectral environment, and the ability to share 100MHz spectrum with an uncooperative communications system. We examine policy iteration, which solves an environment posed as a Markov Decision Process (MDP) by directly solving for a stochastic map** between environmental states and radar waveforms, as well as Deep RL techniques, which utilize a form of Q-Learning to approximate a parameterized function that is used by the radar to select optimal actions. We show that RL techniques are beneficial over a Sense-and-Avoid (SAA) scheme and discuss the conditions under which each approach is most effective. △ Less

Submitted 13 March, 2020; v1 submitted 6 January, 2020; originally announced January 2020.

Comments: Accepted for publication at IEEE Intl. Radar Conference, Washington DC, Apr. 2020. This is the author's version of the work

A Mathematical Justification for Exponentially Distributed NLOS Bias

Authors: Christopher E. O'Lone, Harpreet S. Dhillon, R. Michael Buehrer

Abstract: In the past few decades, the localization literature has seen many models attempting to characterize the non-line-of-sight (NLOS) bias error commonly experienced in range measurements. These models have either been based on specific measurement data or chosen due to attractive features of a particular distribution, yet to date, none have been backed by rigorous analysis. Leveraging tools from stoc… ▽ More In the past few decades, the localization literature has seen many models attempting to characterize the non-line-of-sight (NLOS) bias error commonly experienced in range measurements. These models have either been based on specific measurement data or chosen due to attractive features of a particular distribution, yet to date, none have been backed by rigorous analysis. Leveraging tools from stochastic geometry, this paper attempts to fill this void by providing the first analytical backing for an NLOS bias error model. Using a Boolean model to statistically characterize the random locations, orientations, and sizes of reflectors, and assuming first-order (i.e., single-bounce) reflections, the distance traversed by the first-arriving NLOS path is characterized. Under these assumptions, this analysis reveals that NLOS bias exhibits an exponential form and can in fact be well approximated by an exponential distribution -- a result consistent with previous NLOS bias error models in the literature. This analytically derived distribution is then compared to a common exponential model from the literature, revealing this distribution to be a close match in some cases and a lower bound in others. Lastly, the assumptions under which these results were derived suggest this model is aptly suited to characterize NLOS bias in 5G millimeter wave systems as well. △ Less

Submitted 16 May, 2019; v1 submitted 2 May, 2019; originally announced May 2019.

Comments: Submitted to the 2019 IEEE Global Communications Conference, Waikoloa, HI, USA; [v2, comments] Minor grammatical changes made to improve clarity