-
Parameter Inference of Time Series by Delay Embeddings and Learning Differentiable Operators
Authors:
Alex Tong Lin,
Adrian S. Wong,
Robert Martin,
Stanley J. Osher,
Daniel Eckhardt
Abstract:
We provide a method to identify system parameters of dynamical systems, called ID-ODE -- Inference by Differentiation and Observing Delay Embeddings. In this setting, we are given a dataset of trajectories from a dynamical system with system parameter labels. Our goal is to identify system parameters of new trajectories. The given trajectories may or may not encompass the full state of the system,…
▽ More
We provide a method to identify system parameters of dynamical systems, called ID-ODE -- Inference by Differentiation and Observing Delay Embeddings. In this setting, we are given a dataset of trajectories from a dynamical system with system parameter labels. Our goal is to identify system parameters of new trajectories. The given trajectories may or may not encompass the full state of the system, and we may only observe a one-dimensional time series. In the latter case, we reconstruct the full state by using delay embeddings, and under sufficient conditions, Taken's Embedding Theorem assures us the reconstruction is diffeomorphic to the original. This allows our method to work on time series. Our method works by first learning the velocity operator (as given or reconstructed) with a neural network having both state and system parameters as variable inputs. Then on new trajectories we backpropagate prediction errors to the system parameter inputs giving us a gradient. We then use gradient descent to infer the correct system parameter. We demonstrate the efficacy of our approach on many numerical examples: the Lorenz system, Lorenz96, Lotka-Volterra Predator-Prey, and the Compound Double Pendulum. We also apply our algorithm on a real-world dataset: propulsion of the Hall-effect Thruster (HET).
△ Less
Submitted 16 November, 2022; v1 submitted 11 March, 2022;
originally announced March 2022.
-
Precision annealing Monte Carlo methods for statistical data assimilation and machine learning
Authors:
Zheng Fang,
Adrian S. Wong,
Kangbo Hao,
Alexander J. A. Ty,
Henry D. I. Abarbanel
Abstract:
In statistical data assimilation (SDA) and supervised machine learning (ML), we wish to transfer information from observations to a model of the processes underlying those observations. For SDA, the model consists of a set of differential equations that describe the dynamics of a physical system. For ML, the model is usually constructed using other strategies. In this paper, we develop a systemati…
▽ More
In statistical data assimilation (SDA) and supervised machine learning (ML), we wish to transfer information from observations to a model of the processes underlying those observations. For SDA, the model consists of a set of differential equations that describe the dynamics of a physical system. For ML, the model is usually constructed using other strategies. In this paper, we develop a systematic formulation based on Monte Carlo sampling to achieve such information transfer. Following the derivation of an appropriate target distribution, we present the formulation based on the standard Metropolis-Hasting (MH) procedure and the Hamiltonian Monte Carlo (HMC) method for performing the high dimensional integrals that appear. To the extensive literature on MH and HMC, we add (1) an annealing method using a hyperparameter that governs the precision of the model to identify and explore the highest probability regions of phase space dominating those integrals, and (2) a strategy for initializing the state space search. The efficacy of the proposed formulation is demonstrated using a nonlinear dynamical model with chaotic solutions widely used in geophysics.
△ Less
Submitted 21 January, 2020; v1 submitted 6 July, 2019;
originally announced July 2019.
-
RoboCup Junior in the Hunter Region: Driving the Future of Robotic STEM Education
Authors:
Aaron S. W. Wong,
Ryan Jeffery,
Peter Turner,
Scott Sleap,
Stephan K. Chalup
Abstract:
RoboCup Junior is a project-oriented educational initiative that sponsors regional, national and international robotic events for young students in primary and secondary school. It leads children to the fundamentals of teamwork and complex problem solving through step-by-step logical thinking using computers and robots. The Faculty of Engineering and Built Environment at the University of Newcastl…
▽ More
RoboCup Junior is a project-oriented educational initiative that sponsors regional, national and international robotic events for young students in primary and secondary school. It leads children to the fundamentals of teamwork and complex problem solving through step-by-step logical thinking using computers and robots. The Faculty of Engineering and Built Environment at the University of Newcastle in Australia has hosted and organized the Hunter regional tournament since 2012. This paper presents an analysis of data collected from RoboCup Junior in the Hunter Region, New South Wales, Australia, for a period of six years 2012-2017 inclusive. Our study evaluates the effectiveness of the competition in terms of geographical spread, participation numbers, and gender balance. We also present a case study about current university students who have previously participated in RoboCup Junior.
△ Less
Submitted 4 December, 2018;
originally announced January 2019.
-
Aligning Manifolds of Double Pendulum Dynamics Under the Influence of Noise
Authors:
Fayeem Aziz,
Aaron S. W. Wong,
James S. Welsh,
Stephan K. Chalup
Abstract:
This study presents the results of a series of simulation experiments that evaluate and compare four different manifold alignment methods under the influence of noise. The data was created by simulating the dynamics of two slightly different double pendulums in three-dimensional space. The method of semi-supervised feature-level manifold alignment using global distance resulted in the most convinc…
▽ More
This study presents the results of a series of simulation experiments that evaluate and compare four different manifold alignment methods under the influence of noise. The data was created by simulating the dynamics of two slightly different double pendulums in three-dimensional space. The method of semi-supervised feature-level manifold alignment using global distance resulted in the most convincing visualisations. However, the semi-supervised feature-level local alignment methods resulted in smaller alignment errors. These local alignment methods were also more robust to noise and faster than the other methods.
△ Less
Submitted 20 September, 2018; v1 submitted 18 September, 2018;
originally announced September 2018.
