-
Learning to Predict 3D Rotational Dynamics from Images of a Rigid Body with Unknown Mass Distribution
Authors:
Justice Mason,
Christine Allen-Blanchette,
Nicholas Zolman,
Elizabeth Davison,
Naomi Ehrich Leonard
Abstract:
In many real-world settings, image observations of freely rotating 3D rigid bodies may be available when low-dimensional measurements are not. However, the high-dimensionality of image data precludes the use of classical estimation techniques to learn the dynamics. The usefulness of standard deep learning methods is also limited, because an image of a rigid body reveals nothing about the distribut…
▽ More
In many real-world settings, image observations of freely rotating 3D rigid bodies may be available when low-dimensional measurements are not. However, the high-dimensionality of image data precludes the use of classical estimation techniques to learn the dynamics. The usefulness of standard deep learning methods is also limited, because an image of a rigid body reveals nothing about the distribution of mass inside the body, which, together with initial angular velocity, is what determines how the body will rotate. We present a physics-based neural network model to estimate and predict 3D rotational dynamics from image sequences. We achieve this using a multi-stage prediction pipeline that maps individual images to a latent representation homeomorphic to $\mathbf{SO}(3)$, computes angular velocities from latent pairs, and predicts future latent states using the Hamiltonian equations of motion. We demonstrate the efficacy of our approach on new rotating rigid-body datasets of sequences of synthetic images of rotating objects, including cubes, prisms and satellites, with unknown uniform and non-uniform mass distributions. Our model outperforms competing baselines on our datasets, producing better qualitative predictions and reducing the error observed for the state-of-the-art Hamiltonian Generative Network by a factor of 2.
△ Less
Submitted 10 April, 2024; v1 submitted 24 August, 2023;
originally announced August 2023.
-
Learning Interpretable Dynamics from Images of a Freely Rotating 3D Rigid Body
Authors:
Justice Mason,
Christine Allen-Blanchette,
Nicholas Zolman,
Elizabeth Davison,
Naomi Leonard
Abstract:
In many real-world settings, image observations of freely rotating 3D rigid bodies, such as satellites, may be available when low-dimensional measurements are not. However, the high-dimensionality of image data precludes the use of classical estimation techniques to learn the dynamics and a lack of interpretability reduces the usefulness of standard deep learning methods. In this work, we present…
▽ More
In many real-world settings, image observations of freely rotating 3D rigid bodies, such as satellites, may be available when low-dimensional measurements are not. However, the high-dimensionality of image data precludes the use of classical estimation techniques to learn the dynamics and a lack of interpretability reduces the usefulness of standard deep learning methods. In this work, we present a physics-informed neural network model to estimate and predict 3D rotational dynamics from image sequences. We achieve this using a multi-stage prediction pipeline that maps individual images to a latent representation homeomorphic to $\mathbf{SO}(3)$, computes angular velocities from latent pairs, and predicts future latent states using the Hamiltonian equations of motion with a learned representation of the Hamiltonian. We demonstrate the efficacy of our approach on a new rotating rigid-body dataset with sequences of rotating cubes and rectangular prisms with uniform and non-uniform density.
△ Less
Submitted 23 August, 2023; v1 submitted 22 September, 2022;
originally announced September 2022.
-
Mixed mode oscillations and phase locking in coupled FitzHugh-Nagumo model neurons
Authors:
Elizabeth N. Davison,
Zahra Aminzare,
Biswadip Dey,
Naomi Ehrich Leonard
Abstract:
We study the dynamics of a low-dimensional system of coupled model neurons as a step towards understanding the vastly complex network of neurons in the brain. We analyze the bifurcation structure of a system of two model neurons with unidirectional coupling as a function of two physiologically relevant parameters: the external current input only to the first neuron and the strength of the coupling…
▽ More
We study the dynamics of a low-dimensional system of coupled model neurons as a step towards understanding the vastly complex network of neurons in the brain. We analyze the bifurcation structure of a system of two model neurons with unidirectional coupling as a function of two physiologically relevant parameters: the external current input only to the first neuron and the strength of the coupling from the first to the second neuron. Leveraging a timescale separation, we prove necessary conditions for multiple timescale phenomena observed in the coupled system, including canard solutions and mixed mode oscillations. For a larger network of model neurons, we present a sufficient condition for phase locking when external inputs are heterogeneous. Finally, we generalize our results to directed trees of model neurons with heterogeneous inputs.
△ Less
Submitted 27 July, 2018;
originally announced July 2018.
-
Cluster synchronization of diffusively-coupled nonlinear systems: A contraction based approach
Authors:
Zahra Aminzare,
Biswadip Dey,
Elizabeth N. Davison,
Naomi Ehrich Leonard
Abstract:
Finding the conditions that foster synchronization in networked oscillatory systems is critical to understanding a wide range of biological and mechanical systems. However, the conditions proved in the literature for synchronization in nonlinear systems with linear coupling, such as has been used to model neuronal networks, are in general not strict enough to accurately determine the system behavi…
▽ More
Finding the conditions that foster synchronization in networked oscillatory systems is critical to understanding a wide range of biological and mechanical systems. However, the conditions proved in the literature for synchronization in nonlinear systems with linear coupling, such as has been used to model neuronal networks, are in general not strict enough to accurately determine the system behavior. We leverage contraction theory to derive new sufficient conditions for cluster synchronization in terms of the network structure, for a network where the intrinsic nonlinear dynamics of each node may differ. Our result requires that network connections satisfy a cluster-input-equivalence condition, and we explore the influence of this requirement on network dynamics. For application to networks of nodes with neuronal spiking dynamics, we show that our new sufficient condition is tighter than those found in previous analyses which used nonsmooth Lyapunov functions. Improving the analytical conditions for when cluster synchronization will occur based on network configuration is a significant step toward facilitating understanding and control of complex oscillatory systems.
△ Less
Submitted 3 July, 2017;
originally announced July 2017.
-
Individual Differences in Dynamic Functional Brain Connectivity Across the Human Lifespan
Authors:
Elizabeth N. Davison,
Benjamin O. Turner,
Kimberly J. Schlesinger,
Michael B. Miller,
Scott T. Grafton,
Danielle S. Bassett,
Jean M. Carlson
Abstract:
Individual differences in brain functional networks may be related to complex personal identifiers, including health, age, and ability. Understanding and quantifying these differences is a necessary first step towards develo** predictive methods derived from network topology. Here, we present a method to quantify individual differences in brain functional dynamics by applying hypergraph analysis…
▽ More
Individual differences in brain functional networks may be related to complex personal identifiers, including health, age, and ability. Understanding and quantifying these differences is a necessary first step towards develo** predictive methods derived from network topology. Here, we present a method to quantify individual differences in brain functional dynamics by applying hypergraph analysis, a method from dynamic network theory. Using a summary metric derived from the hypergraph formalism---hypergraph cardinality---we investigate individual variations in two separate and complementary data sets. The first data set ("multi-task") consists of 77 individuals engaging in four consecutive cognitive tasks. We observed that hypergraph cardinality exhibits variation across individuals while remaining consistent within individuals between tasks; moreover, one of the memory tasks evinced a marginally significant correspondence between hypergraph cardinality and age. This finding motivated a similar analysis of the second data set ("age-memory"), in which 95 individuals of varying ages performed a memory task with a similar structure to the multi-task memory task. With the increased age range in the age-memory data set, the correlation between hypergraph cardinality and age correspondence becomes significant. We discuss these results in the context of the well-known finding linking age with network structure, and suggest that age-related changes in brain function can be better understood by taking an integrative approach that incorporates information about the dynamics of functional interactions.
△ Less
Submitted 30 June, 2016;
originally announced June 2016.
-
Brain Network Adaptability Across Task States
Authors:
Elizabeth N. Davison,
Kimberly J. Schlesinger,
Danielle S. Bassett,
Mary-Ellen Lynall,
Michael B. Miller,
Scott T. Grafton,
Jean M. Carlson
Abstract:
Activity in the human brain moves between diverse functional states to meet the demands of our dynamic environment, but fundamental principles guiding these transitions remain poorly understood. Here, we capitalize on recent advances in network science to analyze patterns of functional interactions between brain regions. We use dynamic network representations to probe the landscape of brain reconf…
▽ More
Activity in the human brain moves between diverse functional states to meet the demands of our dynamic environment, but fundamental principles guiding these transitions remain poorly understood. Here, we capitalize on recent advances in network science to analyze patterns of functional interactions between brain regions. We use dynamic network representations to probe the landscape of brain reconfigurations that accompany task performance both within and between four cognitive states: a task-free resting state, an attention-demanding state, and two memory-demanding states. Using the formalism of hypergraphs, we identify the presence of groups of functional interactions that fluctuate coherently in strength over time both within (task-specific) and across (task-general) brain states. In contrast to prior emphases on the complexity of many dyadic (region-to-region) relationships, these results demonstrate that brain adapt- ability can be described by common processes that drive the dynamic integration of cognitive systems. Moreover, our results establish the hypergraph as an effective measure for understanding functional brain dynamics, which may also prove useful in examining cross-task, cross-age, and cross-cohort functional change.
△ Less
Submitted 30 July, 2014;
originally announced July 2014.