-
Unsupervised Quality Prediction for Improved Single-Frame and Weighted Sequential Visual Place Recognition
Authors:
Helen Carson,
Jason J. Ford,
Michael Milford
Abstract:
While substantial progress has been made in the absolute performance of localization and Visual Place Recognition (VPR) techniques, it is becoming increasingly clear from translating these systems into applications that other capabilities like integrity and predictability are just as important, especially for safety- or operationally-critical autonomous systems. In this research we present a new,…
▽ More
While substantial progress has been made in the absolute performance of localization and Visual Place Recognition (VPR) techniques, it is becoming increasingly clear from translating these systems into applications that other capabilities like integrity and predictability are just as important, especially for safety- or operationally-critical autonomous systems. In this research we present a new, training-free approach to predicting the likely quality of localization estimates, and a novel method for using these predictions to bias a sequence-matching process to produce additional performance gains beyond that of a naive sequence matching approach. Our combined system is lightweight, runs in real-time and is agnostic to the underlying VPR technique. On extensive experiments across four datasets and three VPR techniques, we demonstrate our system improves precision performance, especially at the high-precision/low-recall operating point. We also present ablation and analysis identifying the performance contributions of the prediction and weighted sequence matching components in isolation, and the relationship between the quality of the prediction system and the benefits of the weighted sequential matcher.
△ Less
Submitted 3 July, 2023;
originally announced July 2023.
-
Exactly Optimal Quickest Change Detection of Markov Chains
Authors:
Jason J. Ford,
Justin M. Kennedy,
Caitlin Tompkins,
Jasmin James,
Aaron McFadyen
Abstract:
This paper establishes that an exactly optimal rule for Bayesian Quickest Change Detection (QCD) of Markov chains is a threshold test on the no change posterior. We also provide a computationally efficient scalar filter for the no change posterior whose effort is independent of the dimension of the chains. We establish that an (undesirable) weak practical super-martingale phenomenon can be exhibit…
▽ More
This paper establishes that an exactly optimal rule for Bayesian Quickest Change Detection (QCD) of Markov chains is a threshold test on the no change posterior. We also provide a computationally efficient scalar filter for the no change posterior whose effort is independent of the dimension of the chains. We establish that an (undesirable) weak practical super-martingale phenomenon can be exhibited by the no change posterior when the before and after chains are too close in a relative entropy rate sense. The proposed detector is examined in simulation studies.
△ Less
Submitted 23 March, 2023;
originally announced March 2023.
-
Innovation-Based Remote State Estimation Secrecy with no Acknowledgments
Authors:
Justin M. Kennedy,
Jason J. Ford,
Daniel E. Quevedo,
Falko Dressler
Abstract:
Secrecy encoding for remote state estimation in the presence of adversarial eavesdroppers is a well studied problem. Typical existing secrecy encoding schemes rely on the transmitter's knowledge of the remote estimator's current performance. This performance measure is often shared via packet receipt acknowledgments. However, in practical situations the acknowledgment channel may be susceptible to…
▽ More
Secrecy encoding for remote state estimation in the presence of adversarial eavesdroppers is a well studied problem. Typical existing secrecy encoding schemes rely on the transmitter's knowledge of the remote estimator's current performance. This performance measure is often shared via packet receipt acknowledgments. However, in practical situations the acknowledgment channel may be susceptible to interference from an active adversary, resulting in the secrecy encoding scheme failing. Aiming to achieve a reliable state estimate for a legitimate estimator while ensuring secrecy, we propose a secrecy encoding scheme without the need for packet receipt acknowledgments. Our encoding scheme uses a pre-arranged scheduling sequence established at the transmitter and legitimate receiver. We transmit a packet containing either the state measurement or encoded information for the legitimate user. The encoding makes the packet appear to be the state but is designed to damage an eavesdropper's estimate. The pre-arranged scheduling sequence and encoding is chosen psuedo-random. We analyze the performance of our encoding scheme against a class of eavesdropper, and show conditions to force the eavesdropper to have an unbounded estimation performance. Further, we provide a numerical illustration and apply our encoding scheme to an application in power systems.
△ Less
Submitted 15 December, 2022;
originally announced December 2022.
-
Bayesian Quickest Change Detection of an Intruder in Acknowledgments for Private Remote State Estimation
Authors:
Justin M. Kennedy,
Jason J. Ford,
Daniel E. Quevedo
Abstract:
For geographically separated cyber-physical systems, state estimation at a remote monitoring or control site is important to ensure stability and reliability of the system. Often for safety or commercial reasons it is necessary to ensure confidentiality of the process state and control information. A current topic of interest is the private transmission of confidential state information. Many tran…
▽ More
For geographically separated cyber-physical systems, state estimation at a remote monitoring or control site is important to ensure stability and reliability of the system. Often for safety or commercial reasons it is necessary to ensure confidentiality of the process state and control information. A current topic of interest is the private transmission of confidential state information. Many transmission encoding schemes rely on acknowledgments, which may be susceptible to interference from an adversary. We consider a stealthy intruder that selectively blocks acknowledgments allowing an eavesdropper to obtain a reliable state estimate defeating an encoding scheme. We utilize Bayesian Quickest Change Detection techniques to quickly detect online the presence of an intruder at both the remote transmitter and receiver.
△ Less
Submitted 15 December, 2022; v1 submitted 17 July, 2022;
originally announced July 2022.
-
A Dataset of Stationary, Fixed-wing Aircraft on a Collision Course for Vision-Based Sense and Avoid
Authors:
Jasmin Martin,
Jenna Riseley,
Jason J. Ford
Abstract:
The emerging global market for unmanned aerial vehicle (UAV) services is anticipated to reach USD 58.4 billion by 2026, spurring significant efforts to safely integrate routine UAV operations into the national airspace in a manner that they do not compromise the existing safety levels. The commercial use of UAVs would be enhanced by an ability to sense and avoid potential mid-air collision threats…
▽ More
The emerging global market for unmanned aerial vehicle (UAV) services is anticipated to reach USD 58.4 billion by 2026, spurring significant efforts to safely integrate routine UAV operations into the national airspace in a manner that they do not compromise the existing safety levels. The commercial use of UAVs would be enhanced by an ability to sense and avoid potential mid-air collision threats however research in this field is hindered by the lack of available datasets as they are expensive and technically complex to capture. In this paper we present a dataset for vision based aircraft detection. The dataset consists of 15 image sequences containing 55,521 images of a fixed-wing aircraft approaching a stationary, grounded camera. Ground truth labels and a performance benchmark are also provided. To our knowledge, this is the first public dataset for studying medium sized, fixed-wing aircraft on a collision course with the observer. The full dataset and ground truth labels are publicly available at https://qcr.github.io/dataset/aircraft-collision-course/.
△ Less
Submitted 5 December, 2021;
originally announced December 2021.
-
Exactly Optimal Bayesian Quickest Change Detection for Hidden Markov Models
Authors:
Jason J. Ford,
Jasmin James,
Timothy L. Molloy
Abstract:
This paper considers the quickest detection problem for hidden Markov models (HMMs) in a Bayesian setting. We construct an augmented HMM representation of the problem that allows the application of a dynamic programming approach to prove that Shiryaev's rule is an (exact) optimal solution. This augmented representation highlights the problem's fundamental information structure and suggests possibl…
▽ More
This paper considers the quickest detection problem for hidden Markov models (HMMs) in a Bayesian setting. We construct an augmented HMM representation of the problem that allows the application of a dynamic programming approach to prove that Shiryaev's rule is an (exact) optimal solution. This augmented representation highlights the problem's fundamental information structure and suggests possible relaxations to more exotic change event priors not appearing in the literature. Finally, this augmented representation also allows us to present an efficient computational method for implementing the optimal solution.
△ Less
Submitted 15 March, 2023; v1 submitted 31 August, 2020;
originally announced September 2020.
-
Online Inverse Optimal Control for Control-Constrained Discrete-Time Systems on Finite and Infinite Horizons
Authors:
Timothy L. Molloy,
Jason J. Ford,
Tristan Perez
Abstract:
In this paper, we consider the problem of computing parameters of an objective function for a discrete-time optimal control problem from state and control trajectories with active control constraints. We propose a novel method of inverse optimal control that has a computationally efficient online form in which pairs of states and controls from given state and control trajectories are processed seq…
▽ More
In this paper, we consider the problem of computing parameters of an objective function for a discrete-time optimal control problem from state and control trajectories with active control constraints. We propose a novel method of inverse optimal control that has a computationally efficient online form in which pairs of states and controls from given state and control trajectories are processed sequentially without being stored or processed in batches. We establish conditions guaranteeing the uniqueness of the objective-function parameters computed by our proposed method from trajectories with active control constraints. We illustrate our proposed method in simulation.
△ Less
Submitted 13 May, 2020;
originally announced May 2020.
-
On the Informativeness of Measurements in Shiryaev's Bayesian Quickest Change Detection
Authors:
Jason J. Ford,
Jasmin James,
Timothy L. Molloy
Abstract:
This paper provides the first description of a weak practical super-martingale phenomenon that can emerge in the test statistic in Shiryaev's Bayesian quickest change detection (QCD) problem. We establish that this super-martingale phenomenon can emerge under a condition on the relative entropy between pre and post change densities when the measurements are insufficiently informative to overcome t…
▽ More
This paper provides the first description of a weak practical super-martingale phenomenon that can emerge in the test statistic in Shiryaev's Bayesian quickest change detection (QCD) problem. We establish that this super-martingale phenomenon can emerge under a condition on the relative entropy between pre and post change densities when the measurements are insufficiently informative to overcome the change time's geometric prior. We illustrate this super-martingale phenomenon in a simple Bayesian QCD problem which highlights the unsuitability of Shiryaev's test statistic for detecting subtle change events.
△ Less
Submitted 16 September, 2019; v1 submitted 7 March, 2019;
originally announced March 2019.
-
Below Horizon Aircraft Detection Using Deep Learning for Vision-Based Sense and Avoid
Authors:
Jasmin James,
Jason J. Ford,
Timothy L. Molloy
Abstract:
Commercial operation of unmanned aerial vehicles (UAVs) would benefit from an onboard ability to sense and avoid (SAA) potential mid-air collision threats. In this paper we present a new approach for detection of aircraft below the horizon. We address some of the challenges faced by existing vision-based SAA methods such as detecting stationary aircraft (that have no relative motion to the backgro…
▽ More
Commercial operation of unmanned aerial vehicles (UAVs) would benefit from an onboard ability to sense and avoid (SAA) potential mid-air collision threats. In this paper we present a new approach for detection of aircraft below the horizon. We address some of the challenges faced by existing vision-based SAA methods such as detecting stationary aircraft (that have no relative motion to the background), rejecting moving ground vehicles, and simultaneous detection of multiple aircraft. We propose a multi-stage, vision-based aircraft detection system which utilises deep learning to produce candidate aircraft that we track over time. We evaluate the performance of our proposed system on real flight data where we demonstrate detection ranges comparable to the state of the art with the additional capability of detecting stationary aircraft, rejecting moving ground vehicles, and tracking multiple aircraft.
△ Less
Submitted 7 March, 2019;
originally announced March 2019.
-
A Novel Technique for Rejecting Non-Aircraft Artefacts in Above Horizon Vision-Based Aircraft Detection
Authors:
Jasmin James,
Jason J. Ford,
Timothy L. Molloy
Abstract:
Unmanned aerial vehicle (UAV) operations are steadily expanding into many important applications. A key technology for better enabling their commercial use is an onboard sense and avoid (SAA) technology which can detect potential mid-air collision threats in the same manner expected from a human pilot. Ideally, aircraft should be detected as early as possible whilst maintaining a low false alarm r…
▽ More
Unmanned aerial vehicle (UAV) operations are steadily expanding into many important applications. A key technology for better enabling their commercial use is an onboard sense and avoid (SAA) technology which can detect potential mid-air collision threats in the same manner expected from a human pilot. Ideally, aircraft should be detected as early as possible whilst maintaining a low false alarm rate, however, textured clouds and other unstructured terrain make this trade-off a challenge. In this paper we present a new technique for the modelling and detection of aircraft above the horizon that is able to penalise non-aircraft artefacts (such as textured clouds and other unstructured terrain). We evaluate the performance of our proposed system on flight data of a Cessna 172 on a near collision course encounter with a ScanEagle UAV data collection aircraft. By penalising non-aircraft artefacts we are able to demonstrate, for a zero false alarm rate, a mean detection range of 2445m corresponding to an improvement in detection ranges by 9.8% (218m).
△ Less
Submitted 10 February, 2020; v1 submitted 7 March, 2019;
originally announced March 2019.
-
Quickest Detection of Intermittent Signals With Application to Vision Based Aircraft Detection
Authors:
Jasmin James,
Jason J. Ford,
Timothy L. Molloy
Abstract:
In this paper we consider the problem of quickly detecting changes in an intermittent signal that can (repeatedly) switch between a normal and an anomalous state. We pose this intermittent signal detection problem as an optimal stop** problem and establish a quickest intermittent signal detection (ISD) rule with a threshold structure. We develop bounds to characterise the performance of our ISD…
▽ More
In this paper we consider the problem of quickly detecting changes in an intermittent signal that can (repeatedly) switch between a normal and an anomalous state. We pose this intermittent signal detection problem as an optimal stop** problem and establish a quickest intermittent signal detection (ISD) rule with a threshold structure. We develop bounds to characterise the performance of our ISD rule and establish a new filter for estimating its detection delays. Finally, we examine the performance of our ISD rule in both a simulation study and an important vision based aircraft detection application where the ISD rule demonstrates improvements in detection range and false alarm rates relative to the current state of the art aircraft detection techniques.
△ Less
Submitted 25 April, 2018;
originally announced April 2018.
-
Nuclear-spin relaxation of $^{207}$Pb in ferroelectric powders
Authors:
L. -S. Bouchard,
A. O. Sushkov,
D. Budker,
J. J. Ford,
A. S. Lipton
Abstract:
Motivated by a recent proposal by O. P. Sushkov and co-workers to search for a P,T-violating Schiff moment of the $^{207}$Pb nucleus in a ferroelectric solid, we have carried out a high-field nuclear magnetic resonance study of the longitudinal and transverse spin relaxation of the lead nuclei from room temperature down to 10 K for powder samples of lead titanate (PT), lead zirconium titanate (P…
▽ More
Motivated by a recent proposal by O. P. Sushkov and co-workers to search for a P,T-violating Schiff moment of the $^{207}$Pb nucleus in a ferroelectric solid, we have carried out a high-field nuclear magnetic resonance study of the longitudinal and transverse spin relaxation of the lead nuclei from room temperature down to 10 K for powder samples of lead titanate (PT), lead zirconium titanate (PZT), and a PT monocrystal. For all powder samples and independently of temperature, transverse relaxation times were found to be $T_2\approx 1.5 $ms, while the longitudinal relaxation times exhibited a temperature dependence, with $T_1$ of over an hour at the lowest temperatures, decreasing to $T_1\approx 7 $s at room temperature. At high temperatures, the observed behavior is consistent with a two-phonon Raman process, while in the low temperature limit, the relaxation appears to be dominated by a single-phonon (direct) process involving magnetic impurities. This is the first study of temperature-dependent nuclear-spin relaxation in PT and PZT ferroelectrics at such low temperatures. We discuss the implications of the results for the Schiff-moment search.
△ Less
Submitted 15 November, 2007; v1 submitted 8 November, 2007;
originally announced November 2007.