-
Integrating DeepRL with Robust Low-Level Control in Robotic Manipulators for Non-Repetitive Reaching Tasks
Authors:
Mehdi Heydari Shahna,
Seyed Adel Alizadeh Kolagar,
Jouni Mattila
Abstract:
In robotics, contemporary strategies are learning-based, characterized by a complex black-box nature and a lack of interpretability, which may pose challenges in ensuring stability and safety. To address these issues, we propose integrating a collision-free trajectory planner based on deep reinforcement learning (DRL) with a novel auto-tuning low-level control strategy, all while actively engaging…
▽ More
In robotics, contemporary strategies are learning-based, characterized by a complex black-box nature and a lack of interpretability, which may pose challenges in ensuring stability and safety. To address these issues, we propose integrating a collision-free trajectory planner based on deep reinforcement learning (DRL) with a novel auto-tuning low-level control strategy, all while actively engaging in the learning phase through interactions with the environment. This approach circumvents the control performance and complexities associated with computations while addressing nonrepetitive reaching tasks in the presence of obstacles. First, a model-free DRL agent is employed to plan velocity-bounded motion for a manipulator with 'n' degrees of freedom (DoF), ensuring collision avoidance for the end-effector through joint-level reasoning. The generated reference motion is then input into a robust subsystem-based adaptive controller, which produces the necessary torques, while the cuckoo search optimization (CSO) algorithm enhances control gains to minimize the stabilization and tracking error in the steady state. This approach guarantees robustness and uniform exponential convergence in an unfamiliar environment, despite the presence of uncertainties and disturbances. Theoretical assertions are validated through the presentation of simulation outcomes.
△ Less
Submitted 15 May, 2024; v1 submitted 4 February, 2024;
originally announced February 2024.
-
Exponential Auto-Tuning Fault-Tolerant Control of N Degrees-of-Freedom Manipulators Subject to Torque Constraints
Authors:
Mehdi Heydari Shahna,
Jouni Mattila
Abstract:
This paper presents a novel auto-tuning subsystem-based fault-tolerant control (SBFC) system designed for robotic manipulator systems with n degrees of freedom (DoF). It initially proposes a novel model for joint torques, incorporating an actuator fault correction model to account for potential faults and a mathematical saturation function to mitigate issues related to unforeseen excessive torque.…
▽ More
This paper presents a novel auto-tuning subsystem-based fault-tolerant control (SBFC) system designed for robotic manipulator systems with n degrees of freedom (DoF). It initially proposes a novel model for joint torques, incorporating an actuator fault correction model to account for potential faults and a mathematical saturation function to mitigate issues related to unforeseen excessive torque. This model is designed to prevent the generation of excessive torques even by faulty actuators. Subsequently, a robust subsystem-based adaptive control strategy is proposed to force system states closely along desired trajectories, while tolerating various actuator faults, excessive torques, and unknown modeling errors. Furthermore, optimal SBFC gains are determined by tailoring the JAYA algorithm (JA), a high-performance swarm intelligence technique, standing out for its capacity to optimize without the need for meticulous tuning of algorithm-specific parameters, relying instead on its intrinsic principles. Notably, this control framework ensures uniform exponential stability (UES). The enhancement of accuracy and tracking time for reference trajectories, along with the validation of theoretical assertions, is demonstrated through the presentation of simulation outcomes.
△ Less
Submitted 6 February, 2024; v1 submitted 27 November, 2023;
originally announced November 2023.
-
Robustness-Guaranteed Observer-Based Control Strategy with Modularity for Cleantech EMLA-Driven Heavy-Duty Robotic Manipulator
Authors:
Mehdi Heydarishahna,
Mohammad Bahari,
Jouni Mattila
Abstract:
This paper introduces an innovative observer-based modular control strategy in a class of $n_a$-degree-of-freedom (DoF) fully-electrified heavy-duty robotic manipulators (HDRMs) to (1) guarantee robustness in the presence of uncertainties and disturbances, (2) address the complexities arising from several interacting mechanisms, (3) ensure uniformly exponential stability, and (4) enhance overall c…
▽ More
This paper introduces an innovative observer-based modular control strategy in a class of $n_a$-degree-of-freedom (DoF) fully-electrified heavy-duty robotic manipulators (HDRMs) to (1) guarantee robustness in the presence of uncertainties and disturbances, (2) address the complexities arising from several interacting mechanisms, (3) ensure uniformly exponential stability, and (4) enhance overall control performance. To begin with, the dynamic model of the HDRM actuation system that exploits the synergy between cleantech electromechanical linear actuators (EMLAs) and permanent magnet synchronous motors (PMSMs) is investigated. In addition, the reference trajectories of each joint are computed based on direct collocation with B-Spline curves, and simulations on the 3-DoF HDRM are conducted to extract its key kinematic and dynamic quantities. To guarantee the robust tracking of the computed trajectories by the actual motion states, a novel control methodology called robust subsystem-based adaptive (RSBA) control is enhanced through an adaptive state observer. The RSBA control addresses inaccuracies inherent in motion sensors, modeling errors, non-triangular uncertainties, and both torque and voltage disturbances, to which the EMLA-driven HDRM is susceptible. Furthermore, this approach is presented in a unified generic equation format for all subsystems to mitigate the complexities of the entire control system. By applying the RSBA architecture, the uniformly exponential stability of the EMLA-driven HDRM is proved based on the Lyapunov stability theory. The proposed control algorithm is simulated for the scrutinized mechanism, whereby its efficacy in precisely and quickly tracking reference trajectories, alongside the reduction of torque effort, is validated.
△ Less
Submitted 8 April, 2024; v1 submitted 27 November, 2023;
originally announced November 2023.
-
Hybrid Controller for Robot Manipulators in Task-Space with Visual-Inertial Feedback
Authors:
Seyed Hamed Hashemi,
Jouni Mattila
Abstract:
This paper presents a visual-inertial-based control strategy to address the task space control problem of robot manipulators. To this end, an observer-based hybrid controller is employed to control end-effector motion. In addition, a hybrid observer is introduced for a visual-inertial navigation system to close the control loop directly at the Cartesian space by estimating the end-effector pose. A…
▽ More
This paper presents a visual-inertial-based control strategy to address the task space control problem of robot manipulators. To this end, an observer-based hybrid controller is employed to control end-effector motion. In addition, a hybrid observer is introduced for a visual-inertial navigation system to close the control loop directly at the Cartesian space by estimating the end-effector pose. Accordingly, the robot tip is equipped with an inertial measurement unit (IMU) and a stereo camera to provide task-space feedback information for the proposed observer. It is demonstrated through the Lyapunov stability theorem that the resulting closed-loop system under the proposed observer-based controller is globally asymptotically stable. Besides this notable merit (global asymptotic stability), the proposed control method eliminates the need to compute inverse kinematics and increases trajectory tracking accuracy in task-space. The effectiveness and accuracy of the proposed control scheme are evaluated through computer simulations, where the proposed control structure is applied to a 6 degrees-of-freedom long-reach hydraulic robot manipulator.
△ Less
Submitted 20 November, 2023;
originally announced November 2023.
-
Task Space Control of Robot Manipulators based on Visual SLAM
Authors:
Seyed Hamed Hashemi,
Jouni Mattila
Abstract:
This paper aims to address the open problem of designing a globally stable vision-based controller for robot manipulators. Accordingly, based on a hybrid mechanism, this paper proposes a novel task-space control law attained by taking the gradient of a potential function in SE(3). The key idea is to employ the Visual Simultaneous Localization and Map** (VSLAM) algorithm to estimate a robot pose.…
▽ More
This paper aims to address the open problem of designing a globally stable vision-based controller for robot manipulators. Accordingly, based on a hybrid mechanism, this paper proposes a novel task-space control law attained by taking the gradient of a potential function in SE(3). The key idea is to employ the Visual Simultaneous Localization and Map** (VSLAM) algorithm to estimate a robot pose. The estimated robot pose is then used in the proposed hybrid controller as feedback information. Invoking Barbalats lemma and Lyapunov's stability theorem, it is guaranteed that the resulting closed-loop system is globally asymptotically stable, which is the main accomplishment of the proposed structure. Simulation studies are conducted on a six degrees of freedom (6-DOF) robot manipulator to demonstrate the effectiveness and validate the performance of the proposed VSLAM-based control scheme.
△ Less
Submitted 8 February, 2023;
originally announced February 2023.
-
A Global Asymptotic Convergent Observer for SLAM
Authors:
Seyed Hamed Hashemi,
Jouni Mattila
Abstract:
This paper examines the global convergence problem of SLAM algorithms, an issue that faces topological obstructions. This is because the state-space of attitude dynamics is defined on a non-contractible manifold: the special orthogonal group of order three SO(3). Therefore, this paper presents a novel, gradient-based hybrid observer to overcome these topological obstacles. The Lyapunov stability t…
▽ More
This paper examines the global convergence problem of SLAM algorithms, an issue that faces topological obstructions. This is because the state-space of attitude dynamics is defined on a non-contractible manifold: the special orthogonal group of order three SO(3). Therefore, this paper presents a novel, gradient-based hybrid observer to overcome these topological obstacles. The Lyapunov stability theorem is used to prove the globally asymptotic convergence of the proposed algorithm. Finally, comparative analyses of two simulations were conducted to evaluate the performance of the proposed scheme and to demonstrate the superiority of the proposed hybrid observer to a smooth observer.
△ Less
Submitted 4 May, 2022;
originally announced May 2022.
-
Subsystem-Based Control with Modularity for Strict-Feedback Form Nonlinear Systems
Authors:
Janne Koivumäki,
Jukka-Pekka Humaloja,
Lassi Paunonen,
Wen-Hong Zhu,
Jouni Mattila
Abstract:
This study proposes an adaptive subsystem-based control (SBC) for systematic and straightforward nonlinear~control of nth-order strict-feedback form (SFF) systems.~By decomposing the SFF system to subsystems, a generic~term (namely stability connector) can be created to address dynamic interactions between the subsystems. This 1) enables modular control design with global asymptotic stability, 2)…
▽ More
This study proposes an adaptive subsystem-based control (SBC) for systematic and straightforward nonlinear~control of nth-order strict-feedback form (SFF) systems.~By decomposing the SFF system to subsystems, a generic~term (namely stability connector) can be created to address dynamic interactions between the subsystems. This 1) enables modular control design with global asymptotic stability, 2) such that both the control design and the stability analysis can be performed locally at a subsystem level, 3) while avoiding an excessive growth of the control design complexity when the system order n increases. The latter property makes the method suitable especially for high-dimensional systems. We also design a smooth projection function for addressing system parametric uncertainties. Numerical simulations demonstrate the efficiency of the method.
△ Less
Submitted 7 September, 2021;
originally announced September 2021.
-
Decentralized Observer Design for Virtual Decomposition Control
Authors:
Jukka-Pekka Humaloja,
Janne Koivumäki,
Lassi Paunonen,
Jouni Mattila
Abstract:
In this paper, we incorporate velocity observer design into the virtual decomposition control (VDC) strategy of an $n$-DoF open chain robotic manipulator. Descending from the VDC strategy, the proposed design is based on decomposing the $n$-DoF manipulator into subsystems, i.e., rigid links and joints, for which the decentralized controller-observer implementation can be done locally. Similar to V…
▽ More
In this paper, we incorporate velocity observer design into the virtual decomposition control (VDC) strategy of an $n$-DoF open chain robotic manipulator. Descending from the VDC strategy, the proposed design is based on decomposing the $n$-DoF manipulator into subsystems, i.e., rigid links and joints, for which the decentralized controller-observer implementation can be done locally. Similar to VDC, the combined controller-observer design is passivity-based, and we show that it achieves semiglobal exponential convergence of the tracking error. The convergence analysis is carried out using Lyapunov functions based on the observer and controller error dynamics. The proposed design is demonstrated in a simulation study of a 2-DoF open chain robotic manipulator in the vertical plane.
△ Less
Submitted 27 May, 2021; v1 submitted 4 February, 2020;
originally announced February 2020.