-
Deep Ensemble for Rotorcraft Attitude Prediction
Authors:
Hikmat Khan,
Nidhal Carla Bouaynaya,
Ghulam Rasool,
Tyler Travis,
Lacey Thompson,
Charles C. Johnson
Abstract:
Historically, the rotorcraft community has experienced a higher fatal accident rate than other aviation segments, including commercial and general aviation. Recent advancements in artificial intelligence (AI) and the application of these technologies in different areas of our lives are both intriguing and encouraging. When developed appropriately for the aviation domain, AI techniques provide an o…
▽ More
Historically, the rotorcraft community has experienced a higher fatal accident rate than other aviation segments, including commercial and general aviation. Recent advancements in artificial intelligence (AI) and the application of these technologies in different areas of our lives are both intriguing and encouraging. When developed appropriately for the aviation domain, AI techniques provide an opportunity to help design systems that can address rotorcraft safety challenges. Our recent work demonstrated that AI algorithms could use video data from onboard cameras and correctly identify different flight parameters from cockpit gauges, e.g., indicated airspeed. These AI-based techniques provide a potentially cost-effective solution, especially for small helicopter operators, to record the flight state information and perform post-flight analyses. We also showed that carefully designed and trained AI systems could accurately predict rotorcraft attitude (i.e., pitch and yaw) from outside scenes (images or video data). Ordinary off-the-shelf video cameras were installed inside the rotorcraft cockpit to record the outside scene, including the horizon. The AI algorithm could correctly identify rotorcraft attitude at an accuracy in the range of 80\%. In this work, we combined five different onboard camera viewpoints to improve attitude prediction accuracy to 94\%. In this paper, five onboard camera views included the pilot windshield, co-pilot windshield, pilot Electronic Flight Instrument System (EFIS) display, co-pilot EFIS display, and the attitude indicator gauge. Using video data from each camera view, we trained various convolutional neural networks (CNNs), which achieved prediction accuracy in the range of 79\% % to 90\% %. We subsequently ensembled the learned knowledge from all CNNs and achieved an ensembled accuracy of 93.3\%.
△ Less
Submitted 29 June, 2023;
originally announced June 2023.
-
Large-scale Collaborative Filtering with Product Embeddings
Authors:
Thom Lake,
Sinead A. Williamson,
Alexander T. Hawk,
Christopher C. Johnson,
Benjamin P. Wing
Abstract:
The application of machine learning techniques to large-scale personalized recommendation problems is a challenging task. Such systems must make sense of enormous amounts of implicit feedback in order to understand user preferences across numerous product categories. This paper presents a deep learning based solution to this problem within the collaborative filtering with implicit feedback framewo…
▽ More
The application of machine learning techniques to large-scale personalized recommendation problems is a challenging task. Such systems must make sense of enormous amounts of implicit feedback in order to understand user preferences across numerous product categories. This paper presents a deep learning based solution to this problem within the collaborative filtering with implicit feedback framework. Our approach combines neural attention mechanisms, which allow for context dependent weighting of past behavioral signals, with representation learning techniques to produce models which obtain extremely high coverage, can easily incorporate new information as it becomes available, and are computationally efficient. Offline experiments demonstrate significant performance improvements when compared to several alternative methods from the literature. Results from an online setting show that the approach compares favorably with current production techniques used to produce personalized product recommendations.
△ Less
Submitted 11 January, 2019;
originally announced January 2019.
-
The Wild, Elusive Singularities of the T-fractal Surface
Authors:
Charles C. Johnson,
Robert G. Niemeyer
Abstract:
We give a rigorous definition of the T-fractal translation surface, and describe some its basic geometric and dynamical properties. In particular, we study the singularities attached to the surface by its metric completion and show there exists a Cantor set of "elusive singularities." We show these elusive singularities can be thought of as a generalization of the wild singularities introduced by…
▽ More
We give a rigorous definition of the T-fractal translation surface, and describe some its basic geometric and dynamical properties. In particular, we study the singularities attached to the surface by its metric completion and show there exists a Cantor set of "elusive singularities." We show these elusive singularities can be thought of as a generalization of the wild singularities introduced by Bowman and Valdez. In particular, we show that every elusive singularities has an infinite discrete set of rotational components.
△ Less
Submitted 2 April, 2020; v1 submitted 20 March, 2017;
originally announced March 2017.
-
Cutting sequences on square-tiled surfaces
Authors:
Charles C. Johnson
Abstract:
We characterize cutting sequences of infinite geodesics on square-tiled surfaces by considering interval exchanges on specially chosen intervals on the surface. These interval exchanges can be thought of as skew products over a rotation, and we convert cutting sequences to symbolic trajectories of these interval exchanges to show that special types of combinatorial lifts of Sturmian sequences comp…
▽ More
We characterize cutting sequences of infinite geodesics on square-tiled surfaces by considering interval exchanges on specially chosen intervals on the surface. These interval exchanges can be thought of as skew products over a rotation, and we convert cutting sequences to symbolic trajectories of these interval exchanges to show that special types of combinatorial lifts of Sturmian sequences completely describe all cutting sequences on a square-tiled surface. Our results extend the list of families of surfaces where cutting sequences are understood to a dense subset of the moduli space of all translation surfaces.
△ Less
Submitted 2 February, 2017; v1 submitted 17 May, 2016;
originally announced May 2016.
-
High-dimensional Sparse Inverse Covariance Estimation using Greedy Methods
Authors:
Christopher C. Johnson,
Ali Jalali,
Pradeep Ravikumar
Abstract:
In this paper we consider the task of estimating the non-zero pattern of the sparse inverse covariance matrix of a zero-mean Gaussian random vector from a set of iid samples. Note that this is also equivalent to recovering the underlying graph structure of a sparse Gaussian Markov Random Field (GMRF). We present two novel greedy approaches to solving this problem. The first estimates the non-zero…
▽ More
In this paper we consider the task of estimating the non-zero pattern of the sparse inverse covariance matrix of a zero-mean Gaussian random vector from a set of iid samples. Note that this is also equivalent to recovering the underlying graph structure of a sparse Gaussian Markov Random Field (GMRF). We present two novel greedy approaches to solving this problem. The first estimates the non-zero covariates of the overall inverse covariance matrix using a series of global forward and backward greedy steps. The second estimates the neighborhood of each node in the graph separately, again using greedy forward and backward steps, and combines the intermediate neighborhoods to form an overall estimate. The principal contribution of this paper is a rigorous analysis of the sparsistency, or consistency in recovering the sparsity pattern of the inverse covariance matrix. Surprisingly, we show that both the local and global greedy methods learn the full structure of the model with high probability given just $O(d\log(p))$ samples, which is a \emph{significant} improvement over state of the art $\ell_1$-regularized Gaussian MLE (Graphical Lasso) that requires $O(d^2\log(p))$ samples. Moreover, the restricted eigenvalue and smoothness conditions imposed by our greedy methods are much weaker than the strong irrepresentable conditions required by the $\ell_1$-regularization based methods. We corroborate our results with extensive simulations and examples, comparing our local and global greedy methods to the $\ell_1$-regularized Gaussian MLE as well as the Neighborhood Greedy method to that of nodewise $\ell_1$-regularized linear regression (Neighborhood Lasso).
△ Less
Submitted 29 December, 2011;
originally announced December 2011.