-
Direct Imitation Learning-based Visual Servoing using the Large Projection Formulation
Authors:
Sayantan Auddy,
Antonio Paolillo,
Justus Piater,
Matteo Saveriano
Abstract:
Today robots must be safe, versatile, and user-friendly to operate in unstructured and human-populated environments. Dynamical system-based imitation learning enables robots to perform complex tasks stably and without explicit programming, greatly simplifying their real-world deployment. To exploit the full potential of these systems it is crucial to implement closed loops that use visual feedback…
▽ More
Today robots must be safe, versatile, and user-friendly to operate in unstructured and human-populated environments. Dynamical system-based imitation learning enables robots to perform complex tasks stably and without explicit programming, greatly simplifying their real-world deployment. To exploit the full potential of these systems it is crucial to implement closed loops that use visual feedback. Vision permits to cope with environmental changes, but is complex to handle due to the high dimension of the image space. This study introduces a dynamical system-based imitation learning for direct visual servoing. It leverages off-the-shelf deep learning-based perception backbones to extract robust features from the raw input image, and an imitation learning strategy to execute sophisticated robot motions. The learning blocks are integrated using the large projection task priority formulation. As demonstrated through extensive experimental analysis, the proposed method realizes complex tasks with a robotic manipulator.
△ Less
Submitted 13 June, 2024;
originally announced June 2024.
-
Continual Domain Randomization
Authors:
Josip Josifovski,
Sayantan Auddy,
Mohammadhossein Malmir,
Justus Piater,
Alois Knoll,
Nicolás Navarro-Guerrero
Abstract:
Domain Randomization (DR) is commonly used for sim2real transfer of reinforcement learning (RL) policies in robotics. Most DR approaches require a simulator with a fixed set of tunable parameters from the start of the training, from which the parameters are randomized simultaneously to train a robust model for use in the real world. However, the combined randomization of many parameters increases…
▽ More
Domain Randomization (DR) is commonly used for sim2real transfer of reinforcement learning (RL) policies in robotics. Most DR approaches require a simulator with a fixed set of tunable parameters from the start of the training, from which the parameters are randomized simultaneously to train a robust model for use in the real world. However, the combined randomization of many parameters increases the task difficulty and might result in sub-optimal policies. To address this problem and to provide a more flexible training process, we propose Continual Domain Randomization (CDR) for RL that combines domain randomization with continual learning to enable sequential training in simulation on a subset of randomization parameters at a time. Starting from a model trained in a non-randomized simulation where the task is easier to solve, the model is trained on a sequence of randomizations, and continual learning is employed to remember the effects of previous randomizations. Our robotic reaching and gras** tasks experiments show that the model trained in this fashion learns effectively in simulation and performs robustly on the real robot while matching or outperforming baselines that employ combined randomization or sequential randomization without continual learning. Our code and videos are available at https://continual-dr.github.io/.
△ Less
Submitted 18 March, 2024;
originally announced March 2024.
-
Effect of Optimizer, Initializer, and Architecture of Hypernetworks on Continual Learning from Demonstration
Authors:
Sayantan Auddy,
Sebastian Bergner,
Justus Piater
Abstract:
In continual learning from demonstration (CLfD), a robot learns a sequence of real-world motion skills continually from human demonstrations. Recently, hypernetworks have been successful in solving this problem. In this paper, we perform an exploratory study of the effects of different optimizers, initializers, and network architectures on the continual learning performance of hypernetworks for CL…
▽ More
In continual learning from demonstration (CLfD), a robot learns a sequence of real-world motion skills continually from human demonstrations. Recently, hypernetworks have been successful in solving this problem. In this paper, we perform an exploratory study of the effects of different optimizers, initializers, and network architectures on the continual learning performance of hypernetworks for CLfD. Our results show that adaptive learning rate optimizers work well, but initializers specially designed for hypernetworks offer no advantages for CLfD. We also show that hypernetworks that are capable of stable trajectory predictions are robust to different network architectures. Our open-source code is available at https://github.com/sebastianbergner/ExploringCLFD.
△ Less
Submitted 31 December, 2023;
originally announced January 2024.
-
Scalable and Efficient Continual Learning from Demonstration via a Hypernetwork-generated Stable Dynamics Model
Authors:
Sayantan Auddy,
Jakob Hollenstein,
Matteo Saveriano,
Antonio Rodríguez-Sánchez,
Justus Piater
Abstract:
Learning from demonstration (LfD) provides an efficient way to train robots. The learned motions should be convergent and stable, but to be truly effective in the real world, LfD-capable robots should also be able to remember multiple motion skills. Existing stable-LfD approaches lack the capability of multi-skill retention. Although recent work on continual-LfD has shown that hypernetwork-generat…
▽ More
Learning from demonstration (LfD) provides an efficient way to train robots. The learned motions should be convergent and stable, but to be truly effective in the real world, LfD-capable robots should also be able to remember multiple motion skills. Existing stable-LfD approaches lack the capability of multi-skill retention. Although recent work on continual-LfD has shown that hypernetwork-generated neural ordinary differential equation solvers (NODE) can learn multiple LfD tasks sequentially, this approach lacks stability guarantees. We propose an approach for stable continual-LfD in which a hypernetwork generates two networks: a trajectory learning dynamics model, and a trajectory stabilizing Lyapunov function. The introduction of stability generates convergent trajectories, but more importantly it also greatly improves continual learning performance, especially in the size-efficient chunked hypernetworks. With our approach, a single hypernetwork learns stable trajectories of the robot's end-effector position and orientation simultaneously, and does so continually for a sequence of real-world LfD tasks without retraining on past demonstrations. We also propose stochastic hypernetwork regularization with a single randomly sampled regularization term, which reduces the cumulative training time cost for N tasks from O$(N^2)$ to O$(N)$ without any loss in performance on real-world tasks. We empirically evaluate our approach on the popular LASA dataset, on high-dimensional extensions of LASA (including up to 32 dimensions) to assess scalability, and on a novel extended robotic task dataset (RoboTasks9) to assess real-world performance. In trajectory error metrics, stability metrics and continual learning metrics our approach performs favorably, compared to other baselines. Our open-source code and datasets are available at https://github.com/sayantanauddy/clfd-snode.
△ Less
Submitted 9 January, 2024; v1 submitted 6 November, 2023;
originally announced November 2023.
-
PoseGraphNet++: Enriching 3D Human Pose with Orientation Estimation
Authors:
Soubarna Banik,
Edvard Avagyan,
Sayantan Auddy,
Alejandro Mendoza Gracia,
Alois Knoll
Abstract:
Existing skeleton-based 3D human pose estimation methods only predict joint positions. Although the yaw and pitch of bone rotations can be derived from joint positions, the roll around the bone axis remains unresolved. We present PoseGraphNet++ (PGN++), a novel 2D-to-3D lifting Graph Convolution Network that predicts the complete human pose in 3D including joint positions and bone orientations. We…
▽ More
Existing skeleton-based 3D human pose estimation methods only predict joint positions. Although the yaw and pitch of bone rotations can be derived from joint positions, the roll around the bone axis remains unresolved. We present PoseGraphNet++ (PGN++), a novel 2D-to-3D lifting Graph Convolution Network that predicts the complete human pose in 3D including joint positions and bone orientations. We employ both node and edge convolutions to utilize the joint and bone features. Our model is evaluated on multiple datasets using both position and rotation metrics. PGN++ performs on par with the state-of-the-art (SoA) on the Human3.6M benchmark. In generalization experiments, it achieves the best results in position and matches the SoA in orientation, showcasing a more balanced performance than the current SoA. PGN++ exploits the mutual relationship of joints and bones resulting in significantly \SB{improved} position predictions, as shown by our ablation results.
△ Less
Submitted 10 May, 2024; v1 submitted 22 August, 2023;
originally announced August 2023.
-
GRINN: A Physics-Informed Neural Network for solving hydrodynamic systems in the presence of self-gravity
Authors:
Sayantan Auddy,
Ramit Dey,
Neal J. Turner,
Shantanu Basu
Abstract:
Modeling self-gravitating gas flows is essential to answering many fundamental questions in astrophysics. This spans many topics including planet-forming disks, star-forming clouds, galaxy formation, and the development of large-scale structures in the Universe. However, the nonlinear interaction between gravity and fluid dynamics offers a formidable challenge to solving the resulting time-depende…
▽ More
Modeling self-gravitating gas flows is essential to answering many fundamental questions in astrophysics. This spans many topics including planet-forming disks, star-forming clouds, galaxy formation, and the development of large-scale structures in the Universe. However, the nonlinear interaction between gravity and fluid dynamics offers a formidable challenge to solving the resulting time-dependent partial differential equations (PDEs) in three dimensions (3D). By leveraging the universal approximation capabilities of a neural network within a mesh-free framework, physics informed neural networks (PINNs) offer a new way of addressing this challenge. We introduce the gravity-informed neural network (GRINN), a PINN-based code, to simulate 3D self-gravitating hydrodynamic systems. Here, we specifically study gravitational instability and wave propagation in an isothermal gas. Our results match a linear analytic solution to within 1\% in the linear regime and a conventional grid code solution to within 5\% as the disturbance grows into the nonlinear regime. We find that the computation time of the GRINN does not scale with the number of dimensions. This is in contrast to the scaling of the grid-based code for the hydrodynamic and self-gravity calculations as the number of dimensions is increased. Our results show that the GRINN computation time is longer than the grid code in one- and two- dimensional calculations but is an order of magnitude lesser than the grid code in 3D with similar accuracy. Physics-informed neural networks like GRINN thus show promise for advancing our ability to model 3D astrophysical flows.
△ Less
Submitted 15 August, 2023;
originally announced August 2023.
-
Predicting Stellar Mass Accretion: An Optimized Echo State Network Approach in Time Series Modeling
Authors:
Gianfranco Bino,
Shantanu Basu,
Ramit Dey,
Sayantan Auddy,
Lyle Muller,
Eduard I. Vorobyov
Abstract:
Modeling the dynamics of the formation and evolution of protostellar disks as well as the history of stellar mass accretion typically involve the numerical solution of complex systems of coupled differential equations. The resulting mass accretion history of protostars is known to be highly episodic due to recurrent instabilities and also exhibits short timescale flickering. By leveraging the stro…
▽ More
Modeling the dynamics of the formation and evolution of protostellar disks as well as the history of stellar mass accretion typically involve the numerical solution of complex systems of coupled differential equations. The resulting mass accretion history of protostars is known to be highly episodic due to recurrent instabilities and also exhibits short timescale flickering. By leveraging the strong predictive abilities of neural networks, we extract some of the critical temporal dynamics experienced during the mass accretion including periods of instability. Particularly, we utilize a novel form of the Echo-State Neural Network (ESN), which has been shown to efficiently deal with data having inherent nonlinearity. We introduce the use of Optimized-ESN (Opt-ESN) to make model-independent time series forecasting of mass accretion rate in the evolution of protostellar disks. We apply the network to multiple hydrodynamic simulations with different initial conditions and exhibiting a variety of temporal dynamics to demonstrate the predictability of the Opt-ESN model. The model is trained on simulation data of $\sim 1-2$ Myr, and achieves predictions with a low normalized mean square error ($\sim 10^{-5}$ to $10^{-3}$) for forecasts ranging between 100 and 3800 yr. This result shows the promise of the application of machine learning based models to time-domain astronomy.
△ Less
Submitted 13 April, 2023; v1 submitted 7 February, 2023;
originally announced February 2023.
-
Action Noise in Off-Policy Deep Reinforcement Learning: Impact on Exploration and Performance
Authors:
Jakob Hollenstein,
Sayantan Auddy,
Matteo Saveriano,
Erwan Renaudo,
Justus Piater
Abstract:
Many Deep Reinforcement Learning (D-RL) algorithms rely on simple forms of exploration such as the additive action noise often used in continuous control domains. Typically, the scaling factor of this action noise is chosen as a hyper-parameter and is kept constant during training. In this paper, we focus on action noise in off-policy deep reinforcement learning for continuous control. We analyze…
▽ More
Many Deep Reinforcement Learning (D-RL) algorithms rely on simple forms of exploration such as the additive action noise often used in continuous control domains. Typically, the scaling factor of this action noise is chosen as a hyper-parameter and is kept constant during training. In this paper, we focus on action noise in off-policy deep reinforcement learning for continuous control. We analyze how the learned policy is impacted by the noise type, noise scale, and impact scaling factor reduction schedule. We consider the two most prominent types of action noise, Gaussian and Ornstein-Uhlenbeck noise, and perform a vast experimental campaign by systematically varying the noise type and scale parameter, and by measuring variables of interest like the expected return of the policy and the state-space coverage during exploration. For the latter, we propose a novel state-space coverage measure $\operatorname{X}_{\mathcal{U}\text{rel}}$ that is more robust to estimation artifacts caused by points close to the state-space boundary than previously-proposed measures. Larger noise scales generally increase state-space coverage. However, we found that increasing the space coverage using a larger noise scale is often not beneficial. On the contrary, reducing the noise scale over the training process reduces the variance and generally improves the learning performance. We conclude that the best noise type and scale are environment dependent, and based on our observations derive heuristic rules for guiding the choice of the action noise as a starting point for further optimization.
△ Less
Submitted 5 June, 2023; v1 submitted 8 June, 2022;
originally announced June 2022.
-
Using Bayesian Deep Learning to infer Planet Mass from Gaps in Protoplanetary Disks
Authors:
Sayantan Auddy,
Ramit Dey,
Min-Kai Lin,
Daniel Carrera,
Jacob B. Simon
Abstract:
Planet induced sub-structures, like annular gaps, observed in dust emission from protoplanetary disks provide a unique probe to characterize unseen young planets. While deep learning based model has an edge in characterizing the planet's properties over traditional methods, like customized simulations and empirical relations, it lacks in its ability to quantify the uncertainty associated with its…
▽ More
Planet induced sub-structures, like annular gaps, observed in dust emission from protoplanetary disks provide a unique probe to characterize unseen young planets. While deep learning based model has an edge in characterizing the planet's properties over traditional methods, like customized simulations and empirical relations, it lacks in its ability to quantify the uncertainty associated with its predictions. In this paper, we introduce a Bayesian deep learning network "DPNNet-Bayesian" that can predict planet mass from disk gaps and provides uncertainties associated with the prediction. A unique feature of our approach is that it can distinguish between the uncertainty associated with the deep learning architecture and uncertainty inherent in the input data due to measurement noise. The model is trained on a data set generated from disk-planet simulations using the \textsc{fargo3d} hydrodynamics code with a newly implemented fixed grain size module and improved initial conditions. The Bayesian framework enables estimating a gauge/confidence interval over the validity of the prediction when applied to unknown observations. As a proof-of-concept, we apply DPNNet-Bayesian to dust gaps observed in HL Tau. The network predicts masses of $ 86.0 \pm 5.5 M_{\Earth} $, $ 43.8 \pm 3.3 M_{\Earth} $, and $ 92.2 \pm 5.1 M_{\Earth} $ respectively, which are comparable to other studies based on specialized simulations.
△ Less
Submitted 23 February, 2022;
originally announced February 2022.
-
Continual Learning from Demonstration of Robotics Skills
Authors:
Sayantan Auddy,
Jakob Hollenstein,
Matteo Saveriano,
Antonio Rodríguez-Sánchez,
Justus Piater
Abstract:
Methods for teaching motion skills to robots focus on training for a single skill at a time. Robots capable of learning from demonstration can considerably benefit from the added ability to learn new movement skills without forgetting what was learned in the past. To this end, we propose an approach for continual learning from demonstration using hypernetworks and neural ordinary differential equa…
▽ More
Methods for teaching motion skills to robots focus on training for a single skill at a time. Robots capable of learning from demonstration can considerably benefit from the added ability to learn new movement skills without forgetting what was learned in the past. To this end, we propose an approach for continual learning from demonstration using hypernetworks and neural ordinary differential equation solvers. We empirically demonstrate the effectiveness of this approach in remembering long sequences of trajectory learning tasks without the need to store any data from past demonstrations. Our results show that hypernetworks outperform other state-of-the-art continual learning approaches for learning from demonstration. In our experiments, we use the popular LASA benchmark, and two new datasets of kinesthetic demonstrations collected with a real robot that we introduce in this paper called the HelloWorld and RoboTasks datasets. We evaluate our approach on a physical robot and demonstrate its effectiveness in learning real-world robotic tasks involving changing positions as well as orientations. We report both trajectory error metrics and continual learning metrics, and we propose two new continual learning metrics. Our code, along with the newly collected datasets, is available at https://github.com/sayantanauddy/clfd.
△ Less
Submitted 12 April, 2023; v1 submitted 14 February, 2022;
originally announced February 2022.
-
The Magnetic Field versus Density relation in Star-Forming Molecular Clouds
Authors:
Sayantan Auddy,
Shantanu Basu,
Takahiro Kudoh
Abstract:
We study the magnetic field to density ($B-ρ$) relation in turbulent molecular clouds with dynamically important magnetic fields using nonideal three-dimensional magnetohydrodynamic simulations. Our simulations show that there is a distinguishable break density $ρ_{\rm T}$ between the relatively flat low density regime and a power-law regime at higher densities. We present an analytic theory for…
▽ More
We study the magnetic field to density ($B-ρ$) relation in turbulent molecular clouds with dynamically important magnetic fields using nonideal three-dimensional magnetohydrodynamic simulations. Our simulations show that there is a distinguishable break density $ρ_{\rm T}$ between the relatively flat low density regime and a power-law regime at higher densities. We present an analytic theory for $ρ_{\rm T}$ based on the interplay of the magnetic field, turbulence, and gravity. The break density $ρ_{\rm T}$ scales with the strength of the initial Alfvén Mach number $\mathcal{M}_{\rm A0}$ for sub-Alfvénic ( $\mathcal{M}_{\rm A0}<1$) and trans-Alfvénic ($\mathcal{M}_{\rm A0} \sim 1$) clouds. We fit the variation of $ρ_{\rm T}$ for model clouds as a function of $\mathcal{M}_{\rm A0}$, set by different values of initial sonic Mach number $\mathcal{M_{\rm 0}}$ and the initial ratio of gas pressure to magnetic pressure $β_{\rm 0}$. This implies that $ρ_{\rm T}$, which denotes the transition in mass-to-flux ratio from the subcritical to supercritical regime, is set by the initial turbulent compression of the molecular cloud.
△ Less
Submitted 15 March, 2022; v1 submitted 14 January, 2022;
originally announced January 2022.
-
DPNNet-2.0 Part I: Finding hidden planets from simulated images of protoplanetary disk gaps
Authors:
Sayantan Auddy,
Ramit Dey,
Min-Kai Lin,
Cassandra Hall
Abstract:
The observed sub-structures, like annular gaps, in dust emissions from protoplanetary disk, are often interpreted as signatures of embedded planets. Fitting a model of planetary gaps to these observed features using customized simulations or empirical relations can reveal the characteristics of the hidden planets. However, customized fitting is often impractical owing to the increasing sample size…
▽ More
The observed sub-structures, like annular gaps, in dust emissions from protoplanetary disk, are often interpreted as signatures of embedded planets. Fitting a model of planetary gaps to these observed features using customized simulations or empirical relations can reveal the characteristics of the hidden planets. However, customized fitting is often impractical owing to the increasing sample size and the complexity of disk-planet interaction. In this paper we introduce the architecture of DPNNet-2.0, second in the series after DPNNet \citep{aud20}, designed using a Convolutional Neural Network ( CNN, here specifically ResNet50) for predicting exoplanet masses directly from simulated images of protoplanetary disks hosting a single planet. DPNNet-2.0 additionally consists of a multi-input framework that uses both a CNN and multi-layer perceptron (a class of artificial neural network) for processing image and disk parameters simultaneously. This enables DPNNet-2.0 to be trained using images directly, with the added option of considering disk parameters (disk viscosities, disk temperatures, disk surface density profiles, dust abundances, and particle Stokes numbers) generated from disk-planet hydrodynamic simulations as inputs. This work provides the required framework and is the first step towards the use of computer vision (implementing CNN) to directly extract mass of an exoplanet from planetary gaps observed in dust-surface density maps by telescopes such as the Atacama Large (sub-)Millimeter Array.
△ Less
Submitted 19 July, 2021;
originally announced July 2021.
-
How do Offline Measures for Exploration in Reinforcement Learning behave?
Authors:
Jakob J. Hollenstein,
Sayantan Auddy,
Matteo Saveriano,
Erwan Renaudo,
Justus Piater
Abstract:
Sufficient exploration is paramount for the success of a reinforcement learning agent. Yet, exploration is rarely assessed in an algorithm-independent way. We compare the behavior of three data-based, offline exploration metrics described in the literature on intuitive simple distributions and highlight problems to be aware of when using them. We propose a fourth metric,uniform relative entropy, a…
▽ More
Sufficient exploration is paramount for the success of a reinforcement learning agent. Yet, exploration is rarely assessed in an algorithm-independent way. We compare the behavior of three data-based, offline exploration metrics described in the literature on intuitive simple distributions and highlight problems to be aware of when using them. We propose a fourth metric,uniform relative entropy, and implement it using either a k-nearest-neighbor or a nearest-neighbor-ratio estimator, highlighting that the implementation choices have a profound impact on these measures.
△ Less
Submitted 29 October, 2020;
originally announced October 2020.
-
A Machine Learning model to infer planet masses from gaps observed in protoplanetary disks
Authors:
Sayantan Auddy,
Min-Kai Lin
Abstract:
Observations of bright protoplanetary disks often show annular gaps in their dust emission. One interpretation of these gaps is disk-planet interaction. If so, fitting models of planetary gaps to observed protoplanetary disk gaps can reveal the presence of hidden planets. However, future surveys are expected to produce an ever-increasing number of protoplanetary disks with gaps. In this case, perf…
▽ More
Observations of bright protoplanetary disks often show annular gaps in their dust emission. One interpretation of these gaps is disk-planet interaction. If so, fitting models of planetary gaps to observed protoplanetary disk gaps can reveal the presence of hidden planets. However, future surveys are expected to produce an ever-increasing number of protoplanetary disks with gaps. In this case, performing a customized fitting for each target becomes impractical owing to the complexity of disk-planet interaction. To this end, we introduce DPNNet (Disk Planet Neural Network), an efficient model of planetary gaps by exploiting the power of machine learning. We train a deep neural network with a large number of dusty disk-planet hydrodynamic simulations across a range of planet masses, disk temperatures, disk viscosities, disk surface density profiles, particle Stokes numbers, and dust abundances. The network can then be deployed to extract the planet mass for a given gap morphology. In this work, first in a series, we focus on the basic concepts of our machine learning framework. We demonstrate its utility by applying it to the dust gaps observed in the protoplanetary disk around HL Tau at $10$ au, $30$ au, and $80$ au. Our network predict planet masses of $80 \, M_{\rm Earth}$, $63 \, M_{\rm Earth}$, and $70 \, M_{\rm Earth}$, respectively, which are comparable to other studies based on specialized simulations. We discuss the key advantages of our DPNNet in its flexibility to incorporate new physics, any number of parameters and predictions, and its potential to ultimately replace hydrodynamical simulations for disk observers and modelers.
△ Less
Submitted 27 July, 2020;
originally announced July 2020.
-
Magnetic Field Structure in Spheroidal Star-Forming Clouds. II. Estimating Field Structure from Observed Maps
Authors:
Philip C. Myers,
Ian W. Stephens,
Sayantan Auddy,
Shantanu Basu,
Tyler L. Bourke,
Charles L. H. Hull
Abstract:
This paper presents models to estimate the structure of density and magnetic field strength in spheroidal condensations, from maps of their column density and their polarization of magnetically aligned dust grains. The density model is obtained by fitting a column density map with an embedded p = 2 Plummer spheroid of any aspect ratio and inclination. The magnetic properties are based on the densi…
▽ More
This paper presents models to estimate the structure of density and magnetic field strength in spheroidal condensations, from maps of their column density and their polarization of magnetically aligned dust grains. The density model is obtained by fitting a column density map with an embedded p = 2 Plummer spheroid of any aspect ratio and inclination. The magnetic properties are based on the density model, on the Davis-Chandrasekhar-Fermi (DCF) model of Alfvénic fluctuations, and on the Spheroid Flux Freezing (SFF) model of mass and flux conservation in Paper I. The field strength model has the resolution of the column density map, which is finer than the resolution of the DCF estimate of field strength. The models are applied to ALMA observations of the envelope of the protostar BHR71 IRS1. Column density fits give the density model, from (2.0 +- 0.4) x 10^5 cm^-3 to (7 +- 1) x 10^7 cm^-3 . The density model predicts the field directions map, which fits the polarization map best within 1100 au, with standard deviation of angle differences 17°. In this region the DCF mean field strength is 0.7 +- 0.2 mG and the envelope mass is supercritical, with ratio of mass to magnetic critical mass 1.5 +- 0.4. The SFF field strength profile scales with the DCF field strength, from 60 x 10μG to 4+-1 mG. The spatial resolution of the SFF field strength estimate is finer than the DCF resolution by a factor ~7, and the peak SFF field strength exceeds the DCF field strength by a factor ~5.
△ Less
Submitted 8 May, 2020;
originally announced May 2020.
-
Hierarchical Control for Bipedal Locomotion using Central Pattern Generators and Neural Networks
Authors:
Sayantan Auddy,
Sven Magg,
Stefan Wermter
Abstract:
The complexity of bipedal locomotion may be attributed to the difficulty in synchronizing joint movements while at the same time achieving high-level objectives such as walking in a particular direction. Artificial central pattern generators (CPGs) can produce synchronized joint movements and have been used in the past for bipedal locomotion. However, most existing CPG-based approaches do not addr…
▽ More
The complexity of bipedal locomotion may be attributed to the difficulty in synchronizing joint movements while at the same time achieving high-level objectives such as walking in a particular direction. Artificial central pattern generators (CPGs) can produce synchronized joint movements and have been used in the past for bipedal locomotion. However, most existing CPG-based approaches do not address the problem of high-level control explicitly. We propose a novel hierarchical control mechanism for bipedal locomotion where an optimized CPG network is used for joint control and a neural network acts as a high-level controller for modulating the CPG network. By separating motion generation from motion modulation, the high-level controller does not need to control individual joints directly but instead can develop to achieve a higher goal using a low-dimensional control signal. The feasibility of the hierarchical controller is demonstrated through simulation experiments using the Neuro-Inspired Companion (NICO) robot. Experimental results demonstrate the controller's ability to function even without the availability of an exact robot model.
△ Less
Submitted 2 September, 2019;
originally announced September 2019.
-
The Transition from a Lognormal to a Power-Law Column Density Distribution in Molecular Clouds: An Imprint of the Initial Magnetic Field and Turbulence
Authors:
Sayantan Auddy,
Shantanu Basu,
Takahiro Kudoh
Abstract:
We introduce a theory for the development of a transitional column density $Σ_{\rm TP}$ between the lognormal and the power-law forms of the probability distribution function (PDF) in a molecular cloud. Our turbulent magnetohydrodynamic simulations show that the value of $Σ_{\rm TP}$ increases as the strength of both the initial magnetic field and turbulence increases. We develop an analytic expre…
▽ More
We introduce a theory for the development of a transitional column density $Σ_{\rm TP}$ between the lognormal and the power-law forms of the probability distribution function (PDF) in a molecular cloud. Our turbulent magnetohydrodynamic simulations show that the value of $Σ_{\rm TP}$ increases as the strength of both the initial magnetic field and turbulence increases. We develop an analytic expression for $Σ_{\rm TP}$ based on the interplay of turbulence, a (strong) magnetic field, and gravity. The transition value $Σ_{\rm TP}$ scales with $\mathcal{M}^2_{\rm 0}$, the square of the initial sonic Mach number, and $β_{0}$, the initial ratio of gas pressure to magnetic pressure. We fit the variation of $Σ_{\rm TP}$ among different model clouds as a function of $\mathcal{M}^2_{\rm 0} β_{0}$, or equivalently the square of the initial Alfvénic Mach number $\mathcal{M}^2_{\rm A0}$. This implies that the transition value $Σ_{\rm TP}$ is an imprint of cloud initial conditions and is set by turbulent compression of a magnetic cloud. Physically, the value of $Σ_{\rm TP}$ denotes the boundary above which the mass-to-flux ratio becomes supercritical and gravity drives the evolution.
△ Less
Submitted 23 July, 2019;
originally announced July 2019.
-
Magnetic Field Structure of Dense Cores using Spectroscopic Methods
Authors:
Sayantan Auddy,
Philip C. Myers,
Shantanu Basu,
Jorma Harju,
Jaime E. Pineda,
Rachel K. Friesen
Abstract:
We develop a new ''core field structure'' (CFS) model to predict the magnetic field strength and magnetic field fluctuation profile of dense cores using gas kinematics. We use spatially resolved observations of the nonthermal velocity dispersion from the Green Bank Ammonia survey along with column density maps from SCUBA-2 to estimate the magnetic field strength across seven dense cores located in…
▽ More
We develop a new ''core field structure'' (CFS) model to predict the magnetic field strength and magnetic field fluctuation profile of dense cores using gas kinematics. We use spatially resolved observations of the nonthermal velocity dispersion from the Green Bank Ammonia survey along with column density maps from SCUBA-2 to estimate the magnetic field strength across seven dense cores located in the L1688 region of Ophiuchus. The CFS model predicts the profile of the relative field fluctuation, which is related to the observable dispersion in direction of the polarization vectors. Within the context of our model we find that all the cores have a transcritical mass-to-flux ratio.
△ Less
Submitted 28 January, 2019;
originally announced January 2019.
-
Magnetic Field Structure in Spheroidal Star-Forming Clouds
Authors:
Philip C. Myers,
Shantanu Basu,
Sayantan Auddy
Abstract:
A model of magnetic field structure is presented to help test the prevalence of flux freezing in star-forming clouds of various shapes, orientations, and degrees of central concentration, and to estimate their magnetic field strength. The model is based on weak-field flux freezing in centrally condensed Plummer spheres and spheroids of oblate and prolate shape. For a spheroid of given density cont…
▽ More
A model of magnetic field structure is presented to help test the prevalence of flux freezing in star-forming clouds of various shapes, orientations, and degrees of central concentration, and to estimate their magnetic field strength. The model is based on weak-field flux freezing in centrally condensed Plummer spheres and spheroids of oblate and prolate shape. For a spheroid of given density contrast, aspect ratio, and inclination, the model estimates the local field strength and direction, and the global field pattern of hourglass shape. Comparisons with a polarization simulation indicate typical angle agreement within 1 - 10 degrees. Scalable analytic expressions are given to match observed polarization patterns, and to provide inputs to radiative transfer codes for more accurate predictions. The model may apply to polarization observations of dense cores, elongated filamentary clouds, and magnetized circumstellar disks.
△ Less
Submitted 9 October, 2018;
originally announced October 2018.
-
From Molecular Clouds to the IMF: Spatial and Temporal Effects
Authors:
Shantanu Basu,
Sayantan Auddy
Abstract:
We review star formation in molecular clouds and describe why magnetic fields may be important and how they can influence filamentary structure and the column density probability distribution function (PDF). We also comment on the origin of the stellar and substellar initial mass function (IMF), which may require explanations beyond a simple Jeans length argument in turbulent molecular clouds. A m…
▽ More
We review star formation in molecular clouds and describe why magnetic fields may be important and how they can influence filamentary structure and the column density probability distribution function (PDF). We also comment on the origin of the stellar and substellar initial mass function (IMF), which may require explanations beyond a simple Jeans length argument in turbulent molecular clouds. A mathematical model of the modified lognormal power-law (MLP) distribution function provides a framework within which to connect accretion processes with the IMF.
△ Less
Submitted 17 October, 2017;
originally announced October 2017.
-
The Effect of Magnetic Fields and Ambipolar Diffusion on the Column Density Probability Distribution Function in Molecular Clouds
Authors:
Sayantan Auddy,
Shantanu Basu,
Takahiro Kudoh
Abstract:
Simulations generally show that non-self-gravitating clouds have a lognormal column density ($Σ$) probability distribution function (PDF), while self-gravitating clouds with active star formation develop a distinct power-law tail at high column density. Although the growth of the power law can be attributed to gravitational contraction leading to the formation of condensed cores, it is often debat…
▽ More
Simulations generally show that non-self-gravitating clouds have a lognormal column density ($Σ$) probability distribution function (PDF), while self-gravitating clouds with active star formation develop a distinct power-law tail at high column density. Although the growth of the power law can be attributed to gravitational contraction leading to the formation of condensed cores, it is often debated if an observed lognormal shape is a direct consequence of supersonic turbulence alone, or even if it is really observed in molecular clouds. In this paper we run three-dimensional magnetohydrodynamic simulations including ambipolar diffusion with different initial conditions to see the effect of strong magnetic fields and nonlinear initial velocity perturbations on the evolution of the column density PDFs. Our simulations show that column density PDFs of clouds with supercritical mass-to-flux ratio, with either linear perturbations or nonlinear turbulence, quickly develop a power-law tail such that $dN/d \log Σ\propto Σ^{-α}$ with index $α\simeq 2$. Interestingly, clouds with subcritical mass-to-flux ratio also proceed directly to a power-law PDF, but with a much steeper index $α\simeq 4$. This is a result of gravitationally-driven ambipolar diffusion. However, for nonlinear perturbations with a turbulent spectrum ($v_{k}^{2} \propto k^{-4}$), the column density PDFs of subcritical clouds do retain a lognormal shape for a major part of the cloud evolution, and only develop a distinct power-law tail with index $α\simeq 2$ at greater column density when supercritical pockets are formed.
△ Less
Submitted 15 October, 2017;
originally announced October 2017.
-
Magnetic Ribbons: A Minimum Hypothesis Model for Filaments
Authors:
Sayantan Auddy,
Shantanu Basu,
Takahiro Kudoh
Abstract:
We develop a magnetic ribbon model for molecular cloud filaments. These result from turbulent compression in a molecular cloud in which the background magnetic field sets a preferred direction. We use our model to calculate a synthetic observed relation between apparent width in projection versus observed column density. The relationship is relatively flat, in rough agreement with the observations…
▽ More
We develop a magnetic ribbon model for molecular cloud filaments. These result from turbulent compression in a molecular cloud in which the background magnetic field sets a preferred direction. We use our model to calculate a synthetic observed relation between apparent width in projection versus observed column density. The relationship is relatively flat, in rough agreement with the observations, and unlike the simple expectation based on a Jeans length argument.
△ Less
Submitted 16 March, 2017;
originally announced March 2017.
-
The Anomalous Magnetic Moment of a Photon Propagating in a Magnetic Field
Authors:
Julian W. Mielniczuk,
Darrell Lamm,
Sayantan Auddy,
S. R. Valluri
Abstract:
We analyze the spectrum of the Hamiltonian of a photon propagating in a strong magnetic field $B\sim B_{\rm{cr}}$, where $B_{\rm cr}= \frac{m^2}{e} \simeq 4.4 \times 10^{13}$ Gauss is the Schwinger critical field . We show that the expected value of the Hamiltonian of a quantized photon for a perpendicular mode is a concave function of the magnetic field $B$. We show by a partially analytic and nu…
▽ More
We analyze the spectrum of the Hamiltonian of a photon propagating in a strong magnetic field $B\sim B_{\rm{cr}}$, where $B_{\rm cr}= \frac{m^2}{e} \simeq 4.4 \times 10^{13}$ Gauss is the Schwinger critical field . We show that the expected value of the Hamiltonian of a quantized photon for a perpendicular mode is a concave function of the magnetic field $B$. We show by a partially analytic and numerical method that the anomalous magnetic moment of a photon in the one loop approximation is a non - decreasing function of the magnetic field $B$ in the range $0\leq B \leq 30 \, B_{\rm cr}$ We provide a numerical representation of the expression for the anomalous magnetic moment in terms of special functions. We find that the anomalous magnetic moment $μ_γ$ of a photon for $B=30\, B_{\rm cr }$ is $8/3$ of the anomalous magnetic moment of a photon for $B = 1/2 ~ B_{\rm cr}$.
△ Less
Submitted 1 March, 2017; v1 submitted 1 February, 2017;
originally announced February 2017.
-
A Magnetic Ribbon Model for Star-Forming Filaments
Authors:
Sayantan Auddy,
Shantanu Basu,
Takahiro Kudoh
Abstract:
We develop a magnetic ribbon model for molecular cloud filaments. These result from turbulent compression in a molecular cloud in which the background magnetic field sets a preferred direction. We argue that this is a natural model for filaments and is based on the interplay between turbulence, strong magnetic fields, and gravitationally-driven ambipolar diffusion, rather than pure gravity and the…
▽ More
We develop a magnetic ribbon model for molecular cloud filaments. These result from turbulent compression in a molecular cloud in which the background magnetic field sets a preferred direction. We argue that this is a natural model for filaments and is based on the interplay between turbulence, strong magnetic fields, and gravitationally-driven ambipolar diffusion, rather than pure gravity and thermal pressure. An analytic model for the formation of magnetic ribbons that is based on numerical simulations is used to derive a lateral width of a magnetic ribbon. This differs from the thickness along the magnetic field direction, which is essentially the Jeans scale. We use our model to calculate a synthetic observed relation between apparent width in projection versus observed column density. The relationship is relatively flat, similar to observations, and unlike the simple expectation based on a Jeans length argument.
△ Less
Submitted 9 September, 2016;
originally announced September 2016.
-
Analytic Models of Brown Dwarfs and The Substellar Mass Limit
Authors:
Sayantan Auddy,
Shantanu Basu,
S. R. Valluri
Abstract:
We present the current status of the analytic theory of brown dwarf evolution and the lower mass limit of the hydrogen burning main sequence stars. In the spirit of a simplified analytic theory we also introduce some modifications to the existing models. We give an exact expression for the pressure of an ideal non-relativistic Fermi gas at a finite temperature, therefore allowing for non-zero valu…
▽ More
We present the current status of the analytic theory of brown dwarf evolution and the lower mass limit of the hydrogen burning main sequence stars. In the spirit of a simplified analytic theory we also introduce some modifications to the existing models. We give an exact expression for the pressure of an ideal non-relativistic Fermi gas at a finite temperature, therefore allowing for non-zero values of the degeneracy parameter ($ψ= \frac{kT}{μ_{F}}$, where $μ_{F}$ is the Fermi energy). We review the derivation of surface luminosity using an entropy matching condition and the first-order phase transition between the molecular hydrogen in the outer envelope and the partially-ionized hydrogen in the inner region. We also discuss the results of modern simulations of the plasma phase transition, which illustrate the uncertainties in determining its critical temperature. Based on the existing models and with some simple modification we find the maximum mass for a brown dwarf to be in the range $0.064M_\odot-0.087M_\odot$. An analytic formula for the luminosity evolution allows us to estimate the time period of the non-steady state (i.e., non-main sequence) nuclear burning for substellar objects. Standard models also predict that stars that are just above the substellar mass limit can reach an extremely low luminosity main sequence after at least a few million years of evolution, and sometimes much longer. We estimate that $\simeq 11 \%$ of stars take longer than $10^7$ yr to reach the main-sequence, and $\simeq 5 \%$ of stars take longer than $10^8$ yr.
△ Less
Submitted 14 July, 2016;
originally announced July 2016.
-
Gravitational Wave Background in the Quasi-Steady State Cosmology
Authors:
J. V. Narlikar,
S. V. Dhurandhar,
R. G. Vishwakarma,
S. R. Valluri,
Sayantan Auddy
Abstract:
This paper calculates the expected gravitational wave background (GWB) in the quasi-steady state cosmology (QSSC). The principal sources of gravitational waves in the QSSC are the minicreation events (MCE). With suitable assumptions the GWB can be computed both numerically and with analytical methods. It is argued that the GWB in QSSC differs from that predicted for the standard cosmology and a fu…
▽ More
This paper calculates the expected gravitational wave background (GWB) in the quasi-steady state cosmology (QSSC). The principal sources of gravitational waves in the QSSC are the minicreation events (MCE). With suitable assumptions the GWB can be computed both numerically and with analytical methods. It is argued that the GWB in QSSC differs from that predicted for the standard cosmology and a future technology of detectors will be able to decide between the two predictions. We also derive a formula for the flux density of a typical extragalactic source of gravitational waves.
△ Less
Submitted 20 May, 2015;
originally announced May 2015.
-
The MLP Distribution: A Modified Lognormal Power-Law Model for the Stellar Initial Mass Function
Authors:
Shantanu Basu,
M. Gil,
Sayantan Auddy
Abstract:
This work explores the mathematical properties of a distribution introduced by Basu & Jones (2004), and applies it to model the stellar initial mass function (IMF). The distribution arises simply from an initial lognormal distribution, requiring that each object in it subsequently undergoes exponential growth but with an exponential distribution of growth lifetimes. This leads to a modified lognor…
▽ More
This work explores the mathematical properties of a distribution introduced by Basu & Jones (2004), and applies it to model the stellar initial mass function (IMF). The distribution arises simply from an initial lognormal distribution, requiring that each object in it subsequently undergoes exponential growth but with an exponential distribution of growth lifetimes. This leads to a modified lognormal with a power-law tail (MLP) distribution, which can in fact be applied to a wide range of fields where distributions are observed to have a lognormal-like body and a power-law tail. We derive important properties of the MLP distribution, like the cumulative distribution, the mean, variance, arbitrary raw moments, and a random number generator. These analytic properties of the distribution can be used to facilitate application to modeling the IMF. We demonstrate how the MLP function provides an excellent fit to the IMF compiled by Chabrier (2005) and how this fit can be used to quickly identify quantities like the mean, median, and mode, as well as number and mass fractions in different mass intervals.
△ Less
Submitted 27 February, 2015;
originally announced March 2015.
