-
Real-Time Model-Free Deep Reinforcement Learning for Force Control of a Series Elastic Actuator
Authors:
Ruturaj Sambhus,
Aydin Gokce,
Stephen Welch,
Connor W. Herron,
Alexander Leonessa
Abstract:
Many state-of-the art robotic applications utilize series elastic actuators (SEAs) with closed-loop force control to achieve complex tasks such as walking, lifting, and manipulation. Model-free PID control methods are more prone to instability due to nonlinearities in the SEA where cascaded model-based robust controllers can remove these effects to achieve stable force control. However, these mode…
▽ More
Many state-of-the art robotic applications utilize series elastic actuators (SEAs) with closed-loop force control to achieve complex tasks such as walking, lifting, and manipulation. Model-free PID control methods are more prone to instability due to nonlinearities in the SEA where cascaded model-based robust controllers can remove these effects to achieve stable force control. However, these model-based methods require detailed investigations to characterize the system accurately. Deep reinforcement learning (DRL) has proved to be an effective model-free method for continuous control tasks, where few works deal with hardware learning. This paper describes the training process of a DRL policy on hardware of an SEA pendulum system for tracking force control trajectories from 0.05 - 0.35 Hz at 50 N amplitude using the Proximal Policy Optimization (PPO) algorithm. Safety mechanisms are developed and utilized for training the policy for 12 hours (overnight) without an operator present within the full 21 hours training period. The tracking performance is evaluated showing improvements of $25$ N in mean absolute error when comparing the first 18 min. of training to the full 21 hours for a 50 N amplitude, 0.1 Hz sinusoid desired force trajectory. Finally, the DRL policy exhibits better tracking and stability margins when compared to a model-free PID controller for a 50 N chirp force trajectory.
△ Less
Submitted 10 April, 2023;
originally announced April 2023.
-
Thermocapillary Convection in Superimposed Layers of Self-Rewetting Fluids: Analytical and Lattice Boltzmann Computational Study
Authors:
Bashir Elbousefi,
William Schupbach,
Kannan N. Premnath,
Samuel W. J. Welch
Abstract:
Self-rewetting fluids (SRFs), such as aqueous solutions of long-chain alcohols, exhibit anomalous quadratic dependence of surface tension on temperature having a minimum and with a positive gradient. When compared to the normal fluids (NFs), the SRFs can be associated with significantly modified interfacial dynamics, which have recently been exploited to enhance flow and thermal transport in vario…
▽ More
Self-rewetting fluids (SRFs), such as aqueous solutions of long-chain alcohols, exhibit anomalous quadratic dependence of surface tension on temperature having a minimum and with a positive gradient. When compared to the normal fluids (NFs), the SRFs can be associated with significantly modified interfacial dynamics, which have recently been exploited to enhance flow and thermal transport in various applications (e.g., microgravity and microscale transport systems). In this work, first, we develop a new analytical solution of thermocapillary convection in superimposed two SRF layers confined within a microchannel that is sinusoidally heated on one side and maintained at a uniform temperature on the other side under the cree** flow regime. Then, a robust central moment lattice Boltzmann method using the Allen-Cahn equation for interface tracking, two-fluid motion, and the energy transport for numerical simulations of SRFs is constructed. The analytical and computational techniques are generally shown to be in good quantitative agreement with one another. Moreover, the effect of the various characteristic parameters on the magnitude and the distribution thermocapillary-driven motion is studied. The thermocapillary flow patterns in SRFs are shown to be strikingly different when compared to the NFs: For otherwise the same conditions, the SRFs result in eight periodic counterrotating thermocapillary convection rolls, while the NFs exhibit only four such vortices. Moreover, the direction of the circulating fluid motion in such vortical structures for the SRFs is found to be towards the hotter zones on the interfaces, which is opposite to that in NFs. By tuning the sensitivity coefficients of the surface tension on temperature, it is shown that the magnitude as well the overall thermocapillary flow patterns can be significantly manipulated.
△ Less
Submitted 13 October, 2022;
originally announced October 2022.
-
SAUCE: Truncated Sparse Document Signature Bit-Vectors for Fast Web-Scale Corpus Expansion
Authors:
Muntasir Wahed,
Daniel Gruhl,
Alfredo Alba,
Anna Lisa Gentile,
Petar Ristoski,
Chad Deluca,
Steve Welch,
Ismini Lourentzou
Abstract:
Recent advances in text representation have shown that training on large amounts of text is crucial for natural language understanding. However, models trained without predefined notions of topical interest typically require careful fine-tuning when transferred to specialized domains. When a sufficient amount of within-domain text may not be available, expanding a seed corpus of relevant documents…
▽ More
Recent advances in text representation have shown that training on large amounts of text is crucial for natural language understanding. However, models trained without predefined notions of topical interest typically require careful fine-tuning when transferred to specialized domains. When a sufficient amount of within-domain text may not be available, expanding a seed corpus of relevant documents from large-scale web data poses several challenges. First, corpus expansion requires scoring and ranking each document in the collection, an operation that can quickly become computationally expensive as the web corpora size grows. Relying on dense vector spaces and pairwise similarity adds to the computational expense. Secondly, as the domain concept becomes more nuanced, capturing the long tail of domain-specific rare terms becomes non-trivial, especially under limited seed corpora scenarios.
In this paper, we consider the problem of fast approximate corpus expansion given a small seed corpus with a few relevant documents as a query, with the goal of capturing the long tail of a domain-specific set of concept terms. To efficiently collect large-scale domain-specific corpora with limited relevance feedback, we propose a novel truncated sparse document bit-vector representation, termed Signature Assisted Unsupervised Corpus Expansion (SAUCE). Experimental results show that SAUCE can reduce the computational burden while ensuring high within-domain lexical coverage.
△ Less
Submitted 26 August, 2021;
originally announced August 2021.
-
Test and Evaluation Framework for Multi-Agent Systems of Autonomous Intelligent Agents
Authors:
Erin Lanus,
Ivan Hernandez,
Adam Dachowicz,
Laura Freeman,
Melanie Grande,
Andrew Lang,
Jitesh H. Panchal,
Anthony Patrick,
Scott Welch
Abstract:
Test and evaluation is a necessary process for ensuring that engineered systems perform as intended under a variety of conditions, both expected and unexpected. In this work, we consider the unique challenges of develo** a unifying test and evaluation framework for complex ensembles of cyber-physical systems with embedded artificial intelligence. We propose a framework that incorporates test and…
▽ More
Test and evaluation is a necessary process for ensuring that engineered systems perform as intended under a variety of conditions, both expected and unexpected. In this work, we consider the unique challenges of develo** a unifying test and evaluation framework for complex ensembles of cyber-physical systems with embedded artificial intelligence. We propose a framework that incorporates test and evaluation throughout not only the development life cycle, but continues into operation as the system learns and adapts in a noisy, changing, and contended environment. The framework accounts for the challenges of testing the integration of diverse systems at various hierarchical scales of composition while respecting that testing time and resources are limited. A generic use case is provided for illustrative purposes and research directions emerging as a result of exploring the use case via the framework are suggested.
△ Less
Submitted 25 January, 2021;
originally announced January 2021.
-
Enhanced charge density wave coherence in a light-quenched, high-temperature superconductor
Authors:
S. Wandel,
F. Boschini,
E. H. da Silva Neto,
L. Shen,
M. X. Na,
S. Zohar,
Y. Wang,
S. B. Welch,
M. H. Seaberg,
J. D. Koralek,
G. L. Dakovski,
W. Hettel,
M-F. Lin,
S. P. Moeller,
W. F. Schlotter,
A. H. Reid,
M. P. Minitti,
T. Boyle,
F. He,
R. Sutarto,
R. Liang,
D. Bonn,
W. Hardy,
R. A. Kaindl,
D. G. Hawthorn
, et al. (6 additional authors not shown)
Abstract:
Superconductivity and charge density waves (CDW) are competitive, yet coexisting orders in cuprate superconductors. To understand their microscopic interdependence, a probe capable of discerning their interaction on its natural length and time scales is necessary. We use ultrafast resonant soft x-ray scattering to track the transient evolution of CDW correlations in YBa$_{2}$Cu$_{3}$O$_{6+x}$ foll…
▽ More
Superconductivity and charge density waves (CDW) are competitive, yet coexisting orders in cuprate superconductors. To understand their microscopic interdependence, a probe capable of discerning their interaction on its natural length and time scales is necessary. We use ultrafast resonant soft x-ray scattering to track the transient evolution of CDW correlations in YBa$_{2}$Cu$_{3}$O$_{6+x}$ following the quench of superconductivity by an infrared laser pulse. We observe a non-thermal response of the CDW order characterized by a near doubling of the correlation length within $\approx$ 1 picosecond of the superconducting quench. Our results are consistent with a model in which the interaction between superconductivity and CDW manifests inhomogeneously through disruption of spatial coherence, with superconductivity playing the dominant role in stabilizing CDW topological defects, such as discommensurations.
△ Less
Submitted 26 May, 2022; v1 submitted 9 March, 2020;
originally announced March 2020.
-
Central Moment Lattice Boltzmann Method using a Pressure-based Formulation for Multiphase Flows at High Density Ratios and including Effects of Surface Tension and Marangoni Stresses
Authors:
Farzaneh Hajabdollahi,
Kannan Premnath,
Samuel W. J. Welch
Abstract:
Simulation of multiphase flows require coupled capturing or tracking of the interfaces in conjunction with the solution of fluid motion often occurring at multiple scales. We will present unified cascaded LB methods based on central moments for the solution of the incompressible two-phase flows at high density ratios and for capturing of the interfacial dynamics. Based on a modified continuous Bol…
▽ More
Simulation of multiphase flows require coupled capturing or tracking of the interfaces in conjunction with the solution of fluid motion often occurring at multiple scales. We will present unified cascaded LB methods based on central moments for the solution of the incompressible two-phase flows at high density ratios and for capturing of the interfacial dynamics. Based on a modified continuous Boltzmann equation (MCBE) for two-phase flows, where a kinetic transformation to the distribution function involving the pressure field is introduced to reduce the associated numerical stiffness at high density gradients, a central moment cascaded LB formulation for computing the fluid motion will be constructed. In this LB scheme, the collision step is prescribed by the relaxation of various central moments to their equilibria that are reformulated in terms of the pressure field obtained via matching to the continuous equilibria based on the transformed Maxwell distribution. Furthermore, the differential treatments for the effects of the source term representing the change due to the pressure field and of the source term due to the interfacial tension force and body forces appearing in the MCBE on different moments are consistently accounted for in this cascaded LB solver that computes the pressure and velocity fields. In addition, another cascaded LB scheme via modified equilibria will be developed to solve for the interfacial dynamics represented by a phase field model based on the conservative Allen-Cahn equation. Based on numerical simulations of a variety of two-phase flow benchmark problems at high density ratios and involving the effects of surface tension and its tangential gradients (Marangoni stresses), we will validate our unified cascaded LB approach and also demonstrate improvements in numerical stability.
△ Less
Submitted 9 September, 2019;
originally announced September 2019.
-
Cascaded Lattice Boltzmann Method based on Central Moments for Axisymmetric Thermal Flows Including Swirling Effects
Authors:
Farzaneh Hajabdollahi,
Kannan N. Premnath,
Samuel W. J. Welch
Abstract:
A cascaded lattice Boltzmann (LB) approach based on central moments and multiple relaxation times to simulate thermal convective flows, which are driven by buoyancy forces and/or swirling effects, in the cylindrical coordinate system with axial symmetry is presented. In this regard, the dynamics of the axial and radial momentum components along with the pressure are represented by means of the 2D…
▽ More
A cascaded lattice Boltzmann (LB) approach based on central moments and multiple relaxation times to simulate thermal convective flows, which are driven by buoyancy forces and/or swirling effects, in the cylindrical coordinate system with axial symmetry is presented. In this regard, the dynamics of the axial and radial momentum components along with the pressure are represented by means of the 2D Navier-Stokes equations with geometric mass and momentum source terms in the pseudo Cartesian form, while the evolutions of the azimuthal momentum and the temperature field are each modeled by an advection-diffusion type equation with appropriate local source terms. Based on these, cascaded LB schemes involving three distribution functions are formulated to solve for the fluid motion in the meridian plane using a D2Q9 lattice, and to solve for the azimuthal momentum and the temperature field each using a D2Q5 lattice. The geometric mass and momentum source terms for the flow fields and the energy source term for the temperature field are included using a new symmetric operator splitting technique, via pre-collision and post-collision source steps around the cascaded collision step for each distribution function. These result in a particularly simple and compact formulation to directly represent the effect of various geometric source terms consistently in terms of changes in the appropriate zeroth and first order moments. Simulations of several complex buoyancy-driven thermal flows and including rotational effects in cylindrical geometries using the new axisymmetric cascaded LB schemes show good agreement with prior benchmark results for the structures of the velocity and thermal fields as well as the heat transfer rates given in terms of the Nusselt numbers.
△ Less
Submitted 26 June, 2018;
originally announced June 2018.
-
Production and Integration of the ATLAS Insertable B-Layer
Authors:
B. Abbott,
J. Albert,
F. Alberti,
M. Alex,
G. Alimonti,
S. Alkire,
P. Allport,
S. Altenheiner,
L. Ancu,
E. Anderssen,
A. Andreani,
A. Andreazza,
B. Axen,
J. Arguin,
M. Backhaus,
G. Balbi,
J. Ballansat,
M. Barbero,
G. Barbier,
A. Bassalat,
R. Bates,
P. Baudin,
M. Battaglia,
T. Beau,
R. Beccherle
, et al. (352 additional authors not shown)
Abstract:
During the shutdown of the CERN Large Hadron Collider in 2013-2014, an additional pixel layer was installed between the existing Pixel detector of the ATLAS experiment and a new, smaller radius beam pipe. The motivation for this new pixel layer, the Insertable B-Layer (IBL), was to maintain or improve the robustness and performance of the ATLAS tracking system, given the higher instantaneous and i…
▽ More
During the shutdown of the CERN Large Hadron Collider in 2013-2014, an additional pixel layer was installed between the existing Pixel detector of the ATLAS experiment and a new, smaller radius beam pipe. The motivation for this new pixel layer, the Insertable B-Layer (IBL), was to maintain or improve the robustness and performance of the ATLAS tracking system, given the higher instantaneous and integrated luminosities realised following the shutdown. Because of the extreme radiation and collision rate environment, several new radiation-tolerant sensor and electronic technologies were utilised for this layer. This paper reports on the IBL construction and integration prior to its operation in the ATLAS detector.
△ Less
Submitted 6 June, 2018; v1 submitted 2 March, 2018;
originally announced March 2018.
-
Multi-Agent System for Groundwater Depletion Using Game Theory
Authors:
Ying Huang,
Pavel Janovsky,
Sanjoy Das,
Stephen M. Welch,
Scott DeLoach
Abstract:
Groundwater is one of the most vital of all common pool resources throughout the world. More than half of groundwater is used to grow crops. This research models groundwater depletion patterns within a multi-agent system framework. Irrigators are modeled as agents in the multi-agent system. The irrigation strategies adopted by the agents are investigated using game theory. A set of five irrigators…
▽ More
Groundwater is one of the most vital of all common pool resources throughout the world. More than half of groundwater is used to grow crops. This research models groundwater depletion patterns within a multi-agent system framework. Irrigators are modeled as agents in the multi-agent system. The irrigation strategies adopted by the agents are investigated using game theory. A set of five irrigators, growing three crops: corn, sorghum and wheat, have been considered in this study. To allow groundwater flow, these agents are assumed to be located in adjoining farm lands. Irrigators are modeled selfish agents that strategize their irrigation patterns in order to maximize their own utilities, i.e. the difference between the total revenue obtained from crop sales and the costs incurred, including groundwater extraction costs. Due to groundwater flow, and have no incentive to conserve groundwater. This leads to unsustainable depletion of the resource under Nash equilibrium, when no irrigator can increase its utility by unilaterally changing its strategy. All parameters in this research are representative of Kansas. Recorded environmental and economic data of the region, along with the DSSAT software, have been used to obtain these futuristic projections. One of the emergent phenomena of the simulations is the adoption of crop rotation patterns by the irrigators to conserve groundwater. The irrigators grow corn, which is a more profitable yet water intensive crop in one year, and in the next, conserve water by growing sorghum instead. Another emergent outcome of this research is the viability of LEMAs. When the irrigators are subject to LEMA-level limits on groundwater use, there is a slight increase in the aggregate utility of the LEMA.
△ Less
Submitted 7 July, 2016;
originally announced July 2016.
