Showing 1–19 of 19 results for author: Chang, D E

Transversally exponentially stable Euclidean space extension technique for discrete time systems

Authors: Soham Shanbhag, Dong Eui Chang

Abstract: We propose a modification technique for discrete time systems for exponentially fast convergence to compact sets. The extension technique allows us to use tools defined on Euclidean spaces to systems evolving on manifolds by modifying the dynamics of the system such that the manifold is an attractor set. We show the stability properties of this technique using the simulation of the rigid body rota… ▽ More We propose a modification technique for discrete time systems for exponentially fast convergence to compact sets. The extension technique allows us to use tools defined on Euclidean spaces to systems evolving on manifolds by modifying the dynamics of the system such that the manifold is an attractor set. We show the stability properties of this technique using the simulation of the rigid body rotation system on the unit sphere $S^3$. We also show the improvement afforded due to this technique on a Luenberger like observer designed for the rigid body rotation system on $S^3$. △ Less

Submitted 20 January, 2024; originally announced January 2024.

Machine learning based state observer for discrete time systems evolving on Lie groups

Authors: Soham Shanbhag, Dong Eui Chang

Abstract: In this paper, a machine learning based observer for systems evolving on manifolds is designed such that the state of the observer is restricted to the Lie group on which the system evolves. Conventional techniques involving machine learning based observers on systems evolving on Lie groups involve designing charts for the Lie group, training a machine learning based observer for each chart, and s… ▽ More In this paper, a machine learning based observer for systems evolving on manifolds is designed such that the state of the observer is restricted to the Lie group on which the system evolves. Conventional techniques involving machine learning based observers on systems evolving on Lie groups involve designing charts for the Lie group, training a machine learning based observer for each chart, and switching between the trained models based on the state of the system. We propose a novel deep learning based technique whose predictions are restricted to a measure 0 subset of Euclidean space without using charts. Using this network, we design an observer ensuring that the state of the observer is restricted to the Lie group, and predicting the state using only one trained algorithm. The deep learning network predicts an ``error term'' on the Lie algebra of the Lie group, uses the map from the Lie algebra to the group, and uses the group action and the present state to estimate the state at the next epoch. This model being purely data driven does not require the model of the system. The proposed algorithm provides a novel framework for constraining the output of machine learning networks to a measure 0 subset of a Euclidean space without chart specific training and without requiring switching. We show the validity of this method using Monte Carlo simulations performed of the rigid body rotation and translation system. △ Less

Submitted 20 January, 2024; originally announced January 2024.

Angular velocity and linear acceleration measurement bias estimators for the rigid body system with global exponential convergence

Authors: Soham Shanbhag, Dong Eui Chang

Abstract: Rigid body systems usually consider measurements of the pose of the body using onboard cameras/LiDAR systems, that of linear acceleration using an accelerometer and of angular velocity using an IMU. However, the measurements of the linear acceleration and angular velocity are usually biased with an unknown constant or slowly varying bias. We propose a measurement bias estimator for such systems un… ▽ More Rigid body systems usually consider measurements of the pose of the body using onboard cameras/LiDAR systems, that of linear acceleration using an accelerometer and of angular velocity using an IMU. However, the measurements of the linear acceleration and angular velocity are usually biased with an unknown constant or slowly varying bias. We propose a measurement bias estimator for such systems under assumption of boundedness of angular velocity. We also provide continuous estimates to the state of the system, i.e. the pose, linear velocity, and position of the body. These estimates are globally exponentially convergent to the state of the rigid body system. We propose two bias estimators designed with the estimate of the pose in the ambient Euclidean space of the Special Euclidean group and show global exponential convergence of the proposed observers to the state of the system. The first observer assumes knowledge of bounds of the angular velocity, while the second observer uses a Riccati observer to overcome this limitation. We show the convergence with an example of a rigid body rotation and translation system on the special Euclidean group. We show that the observer is able to estimate the bias using data collected from an Intel Realsense camera. △ Less

Submitted 20 January, 2024; originally announced January 2024.

Globally exponentially convergent observer for systems evolving on matrix Lie groups

Authors: Soham Shanbhag, Dong Eui Chang

Abstract: We propose a globally exponentially convergent observer for the dynamical system evolving on matrix Lie groups with bounded velocity with unknown bound. We design the observer in the ambient Euclidean space and show exponential convergence of the observer to the state of the system. We show the convergence with an example of a rigid body rotation and translation system on the special Euclidean gro… ▽ More We propose a globally exponentially convergent observer for the dynamical system evolving on matrix Lie groups with bounded velocity with unknown bound. We design the observer in the ambient Euclidean space and show exponential convergence of the observer to the state of the system. We show the convergence with an example of a rigid body rotation and translation system on the special Euclidean group. We compare the proposed observer with an observer present in the literature. △ Less

Submitted 20 January, 2024; originally announced January 2024.

The Adaptive Dynamic Programming Toolbox

Authors: Xiaowei Xing, Dong Eui Chang

Abstract: The paper develops the Adaptive Dynamic Programming Toolbox (ADPT), which solves optimal control problems for continuous-time nonlinear systems. Based on the adaptive dynamic programming technique, the ADPT computes optimal feedback controls from the system dynamics in the model-based working mode, or from measurements of trajectories of the system in the model-free working mode without the requir… ▽ More The paper develops the Adaptive Dynamic Programming Toolbox (ADPT), which solves optimal control problems for continuous-time nonlinear systems. Based on the adaptive dynamic programming technique, the ADPT computes optimal feedback controls from the system dynamics in the model-based working mode, or from measurements of trajectories of the system in the model-free working mode without the requirement of knowledge of the system model. Multiple options are provided such that the ADPT can accommodate various customized circumstances. Compared to other popular software toolboxes for optimal control, the ADPT enjoys its computational precision and speed, which is illustrated with its applications to a satellite attitude control problem. △ Less

Submitted 29 December, 2020; originally announced December 2020.

Tracking Controller Design for Satellite Attitude Under Unknown Constant Disturbance Using Stable Embedding

Authors: Wonshick Ko, Karmvir Singh Phogat, Nicolas Petit, Dong Eui Chang

Abstract: We propose a tracking control law for the fully actuated rigid body system in the presence of any unknown constant disturbance by employing quaternions with the stable embedding technique and Lyapunov stability theory. The stable embedding technique extends the attitude dynamics from the set of unit quaternions to the set of quaternions, which is a Euclidean space, such that the set of unit quater… ▽ More We propose a tracking control law for the fully actuated rigid body system in the presence of any unknown constant disturbance by employing quaternions with the stable embedding technique and Lyapunov stability theory. The stable embedding technique extends the attitude dynamics from the set of unit quaternions to the set of quaternions, which is a Euclidean space, such that the set of unit quaternions is an invariant set of the extended dynamics. Such a stable extension of the system dynamics to a Euclidean space allows us to employ well studied Lyapunov techniques in Euclidean spaces such as LaSalle-Yoshizawa's theorem. A robust tracking control law is proposed for the attitude dynamics subject to unknown constant disturbance and the convergence properties of the tracking control law is rigorously proven. It is demonstrated with the help of numerical simulations that the proposed control law has a remarkable performance even in some challenging situations. △ Less

Submitted 3 October, 2020; originally announced October 2020.

Invariant extended Kalman filter on matrix Lie groups

Authors: Karmvir Singh Phogat, Dong Eui Chang

Abstract: We derive symmetry preserving invariant extended Kalman filters (IEKF) on matrix Lie groups. These Kalman filters have an advantage over conventional extended Kalman filters as the error dynamics for such filters are independent of the group configuration which, in turn, provides a uniform estimate of the region of convergence. The proposed IEKF differs from existing techniques in literature on th… ▽ More We derive symmetry preserving invariant extended Kalman filters (IEKF) on matrix Lie groups. These Kalman filters have an advantage over conventional extended Kalman filters as the error dynamics for such filters are independent of the group configuration which, in turn, provides a uniform estimate of the region of convergence. The proposed IEKF differs from existing techniques in literature on the account that it is derived using minimal tools from differential geometry that simplifies its representation and derivation to a large extent. The filter error dynamics is defined on the Lie algebra directly instead of identifying the Lie algebra with an Euclidean space or defining the error dynamics in local coordinates using exponential map, and the associated differential Riccati equations are described on the corresponding space of linear operators using tensor algebra. The proposed filter is implemented for the attitude dynamics of the rigid body, which is a benchmark problem in control, and its performance is compared against a conventional extended Kalman filter (EKF). Numerical experiments support that the IEKF is computationally less intensive and gives better performance than the EKF. △ Less

Submitted 28 December, 2019; originally announced December 2019.

Model Predictive Tracking Control for Invariant Systems on Matrix Lie Groups via Stable Embedding into Euclidean Spaces

Authors: Dong Eui Chang, Karmvir Singh Phogat, Jongeun Choi

Abstract: For controller design for systems on manifolds embedded in Euclidean space, it is convenient to utilize a theory that requires a single global coordinate system on the ambient Euclidean space rather than multiple local charts on the manifold or coordinate-free tools from differential geometry. In this article, we apply such a theory to design model predictive tracking controllers for systems whose… ▽ More For controller design for systems on manifolds embedded in Euclidean space, it is convenient to utilize a theory that requires a single global coordinate system on the ambient Euclidean space rather than multiple local charts on the manifold or coordinate-free tools from differential geometry. In this article, we apply such a theory to design model predictive tracking controllers for systems whose dynamics evolve on manifolds and illustrate its efficacy with the fully actuated rigid body attitude control system. △ Less

Submitted 12 October, 2019; originally announced October 2019.

Design of Globally Exponentially Convergent Continuous Observers for Velocity Bias and State for Systems on Real Matrix Groups

Authors: Dong Eui Chang

Abstract: We propose globally exponentially convergent continuous observers for invariant kinematic systems on finite-dimensional matrix Lie groups. Such an observer estimates, from measurements of landmarks, vectors and biased velocity, both the system state and the unknown constant bias in velocity measurement, where the state belongs to the state-space Lie group and the velocity to the Lie algebra of the… ▽ More We propose globally exponentially convergent continuous observers for invariant kinematic systems on finite-dimensional matrix Lie groups. Such an observer estimates, from measurements of landmarks, vectors and biased velocity, both the system state and the unknown constant bias in velocity measurement, where the state belongs to the state-space Lie group and the velocity to the Lie algebra of the Lie group. The main technique is to embed a given system defined on a matrix Lie group into Euclidean space and build observers in the Euclidean space. The theory is illustrated with the special Euclidean group in three dimensions. △ Less

Submitted 23 September, 2019; originally announced September 2019.

Deep Reinforcement Learning Based Robot Arm Manipulation with Efficient Training Data through Simulation

Authors: Xiaowei Xing, Dong Eui Chang

Abstract: Deep reinforcement learning trains neural networks using experiences sampled from the replay buffer, which is commonly updated at each time step. In this paper, we propose a method to update the replay buffer adaptively and selectively to train a robot arm to accomplish a suction task in simulation. The response time of the agent is thoroughly taken into account. The state transitions that remain… ▽ More Deep reinforcement learning trains neural networks using experiences sampled from the replay buffer, which is commonly updated at each time step. In this paper, we propose a method to update the replay buffer adaptively and selectively to train a robot arm to accomplish a suction task in simulation. The response time of the agent is thoroughly taken into account. The state transitions that remain stuck at the boundary of constraint are not stored. The policy trained with our method works better than the one with the common replay buffer update method. The result is demonstrated both by simulation and by experiment with a real robot arm. △ Less

Submitted 5 September, 2019; v1 submitted 16 July, 2019; originally announced July 2019.

Comments: Appearing in The 19th International Conference on Control, Automation and Systems, Jeju, Korea, 2019

Improved Reinforcement Learning through Imitation Learning Pretraining Towards Image-based Autonomous Driving

Authors: Tianqi Wang, Dong Eui Chang

Abstract: We present a training pipeline for the autonomous driving task given the current camera image and vehicle speed as the input to produce the throttle, brake, and steering control output. The simulator Airsim's convenient weather and lighting API provides a sufficient diversity during training which can be very helpful to increase the trained policy's robustness. In order to not limit the possible p… ▽ More We present a training pipeline for the autonomous driving task given the current camera image and vehicle speed as the input to produce the throttle, brake, and steering control output. The simulator Airsim's convenient weather and lighting API provides a sufficient diversity during training which can be very helpful to increase the trained policy's robustness. In order to not limit the possible policy's performance, we use a continuous and deterministic control policy setting. We utilize ResNet-34 as our actor and critic networks with some slight changes in the fully connected layers. Considering human's mastery of this task and the high-complexity nature of this task, we first use imitation learning to mimic the given human policy and leverage the trained policy and its weights to the reinforcement learning phase for which we use DDPG. This combination shows a considerable performance boost comparing to both pure imitation learning and pure DDPG for the autonomous driving task. △ Less

Submitted 16 July, 2019; originally announced July 2019.

Comments: 5 pages, 2019 19th International Conference on Control, Automation and Systems (ICCAS 2019)

Noise Removal of FTIR Hyperspectral Images via MMSE

Authors: Chang Sik Lee, Hyeong Geun Yu, Dong Jo Park, Dong Eui Chang, Hyunwoo Nam, Byeong Hwang Park

Abstract: Fourier transform infrared (FTIR) hyperspectral imaging systems are deployed in various fields where spectral information is exploited. Chemical warfare agent (CWA) detection is one of such fields and it requires a fast and accurate process from the measurement to the visualization of detection results, including noise removal. A general concern of existing noise removal algorithms is a trade-off… ▽ More Fourier transform infrared (FTIR) hyperspectral imaging systems are deployed in various fields where spectral information is exploited. Chemical warfare agent (CWA) detection is one of such fields and it requires a fast and accurate process from the measurement to the visualization of detection results, including noise removal. A general concern of existing noise removal algorithms is a trade-off between time and performance. This paper suggests a minimum mean square error (MMSE) approach as an efficient noise removal algorithm for FTIR hyperspectral images. The experimental result shows that the MMSE estimator spends less time to achieve comparable performance to the existing algorithms. △ Less

Submitted 29 December, 2019; v1 submitted 16 July, 2019; originally announced July 2019.

Robotic Navigation using Entropy-Based Exploration

Authors: Muhammad Usama, Dong Eui Chang

Abstract: Robotic navigation concerns the task in which a robot should be able to find a safe and feasible path and traverse between two points in a complex environment. We approach the problem of robotic navigation using reinforcement learning and use deep $Q$-networks to train agents to solve the task of robotic navigation. We compare the Entropy-Based Exploration (EBE) with the widely used $ε$-greedy exp… ▽ More Robotic navigation concerns the task in which a robot should be able to find a safe and feasible path and traverse between two points in a complex environment. We approach the problem of robotic navigation using reinforcement learning and use deep $Q$-networks to train agents to solve the task of robotic navigation. We compare the Entropy-Based Exploration (EBE) with the widely used $ε$-greedy exploration strategy by training agents using both of them in simulation. The trained agents are then tested on different versions of the environment to test the generalization ability of the learned policies. We also implement the learned policies on a real robot in complex real environment without any fine tuning and compare the effectiveness of the above-mentioned exploration strategies in the real world setting. Video showing experiments on TurtleBot3 platform is available at \url{https://youtu.be/NHT-EiN_4n8}. △ Less

Submitted 17 June, 2019; originally announced June 2019.

Comments: 5 pages

Enhancement of Energy-Based Swing-Up Controller via Entropy Search

Authors: Chang Sik Lee, Dong Eui Chang

Abstract: An energy based approach for stabilizing a mechanical system has offered a simple yet powerful control scheme. However, since it does not impose such strong constraints on parameter space of the controller, finding appropriate parameter values for an optimal controller is known to be hard. This paper intends to generate an optimal energy-based controller for swinging up a rotary inverted pendulum,… ▽ More An energy based approach for stabilizing a mechanical system has offered a simple yet powerful control scheme. However, since it does not impose such strong constraints on parameter space of the controller, finding appropriate parameter values for an optimal controller is known to be hard. This paper intends to generate an optimal energy-based controller for swinging up a rotary inverted pendulum, also known as the Furuta pendulum, by applying the Bayesian optimization called Entropy Search. Simulations and experiments show that the optimal controller has an improved performance compared to a nominal controller for various initial conditions. △ Less

Submitted 3 April, 2019; v1 submitted 2 April, 2019; originally announced April 2019.

Comments: 6 pages, 2019 Asian Control Conference

On the Decomposition of Forces

Authors: Dong Eui Chang

Abstract: We show that any continuously differentiable force is decomposed into the sum of a Rayleigh force and a gyroscopic force. We also extend this result to piecewise continuously differentiable forces. Our result improves the result on the decomposition of forces in a book by David Merkin and further extends it to piecewise continuously differentiable forces. We show that any continuously differentiable force is decomposed into the sum of a Rayleigh force and a gyroscopic force. We also extend this result to piecewise continuously differentiable forces. Our result improves the result on the decomposition of forces in a book by David Merkin and further extends it to piecewise continuously differentiable forces. △ Less

Submitted 10 July, 2018; originally announced July 2018.

Journal ref: THEORETICAL & APPLIED MECHANICS LETTERS,4, 043001, 2014

On Controller Design for Systems on Manifolds in Euclidean Space

Authors: Dong Eui Chang

Abstract: A new method is developed to design controllers in Euclidean space for systems defined on manifolds. The idea is to embed the state-space manifold $M$ of a given control system into some Euclidean space $\mathbb R^n$, extend the system from $M$ to the ambient space $\mathbb R^n$, and modify it outside $M$ to add transversal stability to $M$ in the final dynamics in $\mathbb R^n$. Controllers are d… ▽ More A new method is developed to design controllers in Euclidean space for systems defined on manifolds. The idea is to embed the state-space manifold $M$ of a given control system into some Euclidean space $\mathbb R^n$, extend the system from $M$ to the ambient space $\mathbb R^n$, and modify it outside $M$ to add transversal stability to $M$ in the final dynamics in $\mathbb R^n$. Controllers are designed for the final system in the ambient space $\mathbb R^n$. Then, their restriction to $M$ produces controllers for the original system on $M$. This method has the merit that only one single global Cartesian coordinate system in the ambient space $\mathbb R^n$ is used for controller synthesis, and any controller design method in $\mathbb R^n$, such as the linearization method, can be globally applied for the controller synthesis. The proposed method is successfully applied to the tracking problem for the following two benchmark systems: the fully actuated rigid body system and the quadcopter drone system. △ Less

Submitted 10 July, 2018; originally announced July 2018.

Comments: International Journal of Robust and Nonlinear Control (Accepted July 2018

Journal ref: International J of Robust and Nonlinear Control, 28(16), 4981--4998, 2018

Observer-Based Controller Design for Systems on Manifolds in Euclidean Space

Authors: Dong Eui Chang

Abstract: A method of designing observers and observer-based tracking controllers is proposed for nonlinear systems on manifolds via embedding into Euclidean space and transversal stabilization. Given a system on a manifold, we first embed the manifold and the system into Euclidean space and extend the system dynamics to the ambient Euclidean space in such a way that the manifold becomes an invariant attrac… ▽ More A method of designing observers and observer-based tracking controllers is proposed for nonlinear systems on manifolds via embedding into Euclidean space and transversal stabilization. Given a system on a manifold, we first embed the manifold and the system into Euclidean space and extend the system dynamics to the ambient Euclidean space in such a way that the manifold becomes an invariant attractor of the extended system, thus securing the transversal stability of the manifold in the extended dynamics. After the embedding, we design state observers and observer-based controllers for the extended system in one single global coordinate system in the ambient Euclidean space, and then restrict them to the original state-space manifold to produce observers and observer-based controllers for the original system on the manifold. This procedure has the merit that any existing control method that has been developed in Euclidean space can be applied globally to systems defined on nonlinear manifolds, thus making nonlinear controller design on manifolds easier. The detail of the method is demonstrated on the fully actuated rigid body system. △ Less

Submitted 16 June, 2018; originally announced June 2018.

Comments: SICE Annual Conference, Nara, Japan, September, 2018

A Global, Continuous, and Exponentially Convergent Observer for Gyro Bias and Attitude of a Rigid Body

Authors: Dong Eui Chang, Taeyoung Lee

Abstract: We propose a 12-dimensional, global, continuous, and exponentially convergent observer for gyro bias and attitude of a rigid body. Any attitude observer developed on the special orthogonal group suffers from the topological restriction that prohibits global attractivity in continuous flow. In this paper, the observer is designed in the set of 3 by 3 real matrices, thus making the topological obstr… ▽ More We propose a 12-dimensional, global, continuous, and exponentially convergent observer for gyro bias and attitude of a rigid body. Any attitude observer developed on the special orthogonal group suffers from the topological restriction that prohibits global attractivity in continuous flow. In this paper, the observer is designed in the set of 3 by 3 real matrices, thus making the topological obstruction on the special orthogonal group irrelevant. The efficacy of the proposed approach against other attitude observers is illustrated by an indoor experiment utilizing visual landmarks. △ Less

Submitted 23 September, 2019; v1 submitted 13 May, 2018; originally announced May 2018.

Controller Design for Systems on Manifolds in Euclidean Space

Authors: Dong Eui Chang

Abstract: Given a control system on a manifold that is embedded in Euclidean space, it is sometimes convenient to use a single global coordinate system in the ambient Euclidean space for controller design rather than to use multiple local charts on the manifold or coordinate-free tools from differential geometry. In this paper, we develop a theory about this and apply it to the fully actuated rigid body sys… ▽ More Given a control system on a manifold that is embedded in Euclidean space, it is sometimes convenient to use a single global coordinate system in the ambient Euclidean space for controller design rather than to use multiple local charts on the manifold or coordinate-free tools from differential geometry. In this paper, we develop a theory about this and apply it to the fully actuated rigid body system for stabilization and tracking. A noteworthy point in this theory is that we legitimately modify the system dynamics outside its state-space manifold before controller design so as to add attractiveness to the manifold in the resulting dynamics. △ Less

Submitted 8 October, 2017; originally announced October 2017.

Comments: Proc. 56th IEEE Conference on Decision and Control, Melbourne, Australia, December 2017