-
An NMPC-ECBF Framework for Dynamic Motion Planning and Execution in vision-based Human-Robot Collaboration
Authors:
Dianhao Zhang,
Mien Van,
Pantelis Sopasakis,
Seán McLoone
Abstract:
To enable safe and effective human-robot collaboration (HRC) in smart manufacturing, seamless integration of sensing, cognition, and prediction into the robot controller is critical for real-time awareness, response, and communication inside a heterogeneous environment (robots, humans, and equipment). The proposed approach takes advantage of the prediction capabilities of nonlinear model predictiv…
▽ More
To enable safe and effective human-robot collaboration (HRC) in smart manufacturing, seamless integration of sensing, cognition, and prediction into the robot controller is critical for real-time awareness, response, and communication inside a heterogeneous environment (robots, humans, and equipment). The proposed approach takes advantage of the prediction capabilities of nonlinear model predictive control (NMPC) to execute a safe path planning based on feedback from a vision system. In order to satisfy the requirement of real-time path planning, an embedded solver based on a penalty method is applied. However, due to tight sampling times NMPC solutions are approximate, and hence the safety of the system cannot be guaranteed. To address this we formulate a novel safety-critical paradigm with an exponential control barrier function (ECBF) used as a safety filter. We also design a simple human-robot collaboration scenario using V-REP to evaluate the performance of the proposed controller and investigate whether integrating human pose prediction can help with safe and efficient collaboration. The robot uses OptiTrack cameras for perception and dynamically generates collision-free trajectories to the predicted target interactive position. Results for a number of different configurations confirm the efficiency of the proposed motion planning and execution framework. It yields a 19.8% reduction in execution time for the HRC task considered.
△ Less
Submitted 19 October, 2023; v1 submitted 14 April, 2023;
originally announced April 2023.
-
Circularity of Thermodynamical Material Networks: Indicators, Examples, and Algorithms
Authors:
Federico Zocco,
Beatrice Smyth,
Pantelis Sopasakis
Abstract:
The transition towards a circular economy has gained importance over the last years since the traditional linear take-make-dispose paradigm is not sustainable in the long term. Recently, thermodynamical material networks (TMNs) [1] have been proposed as an approach to re-design material flows based on the idea that any supply chain can be seen as a set of thermodynamic compartments that can be add…
▽ More
The transition towards a circular economy has gained importance over the last years since the traditional linear take-make-dispose paradigm is not sustainable in the long term. Recently, thermodynamical material networks (TMNs) [1] have been proposed as an approach to re-design material flows based on the idea that any supply chain can be seen as a set of thermodynamic compartments that can be added, removed, modified or connected differently. In this paper, we develop several circularity indicators of TMNs using a graph-based formalism and illustrate their calculation through examples. The paper source code is publicly available.
△ Less
Submitted 13 December, 2022; v1 submitted 29 September, 2022;
originally announced September 2022.
-
Thermodynamical Material Networks for Modeling, Planning, and Control of Circular Material Flows
Authors:
Federico Zocco,
Pantelis Sopasakis,
Beatrice Smyth,
Wassim M. Haddad
Abstract:
Waste production, carbon dioxide atmospheric accumulation, and dependence on finite natural resources are expressions of the unsustainability of the current industrial networks that supply fuels, energy, and manufacturing products. In particular, circular manufacturing supply chains and carbon control networks are urgently needed. To model and design these and, in general, any material networks, w…
▽ More
Waste production, carbon dioxide atmospheric accumulation, and dependence on finite natural resources are expressions of the unsustainability of the current industrial networks that supply fuels, energy, and manufacturing products. In particular, circular manufacturing supply chains and carbon control networks are urgently needed. To model and design these and, in general, any material networks, we propose to generalize the approach used for traditional networks such as water and thermal power systems by using compartmental dynamical thermodynamics and graph theory. The key idea is that the thermodynamic compartments and their connections can be added, removed or modified as needed to achieve a circular material flow. The design methodology is explained and its application is illustrated through examples. In addition, we provide a physics-based definition of circularity and, by implementing a nonlinear compartmental control, we strengthen the connection between "Industry 4.0" and "Sustainability". The paper source code is publicly available.
△ Less
Submitted 14 November, 2022; v1 submitted 20 November, 2021;
originally announced November 2021.
-
Collision avoidance for multiple MAVs using fast centralized NMPC
Authors:
Björn Lindqvist,
Sina Sharif Mansouri,
Pantelis Sopasakis,
George Nikolakopoulos
Abstract:
This article proposes a novel control architecture using a centralized nonlinear model predictive control (CNMPC) scheme for controlling multiple micro aerial vehicles (MAVs). The control architecture uses an augmented state system to control multiple agents and performs both obstacle and collision avoidance. The optimization algorithm used is OpEn, based on the proximal averaged Newton type metho…
▽ More
This article proposes a novel control architecture using a centralized nonlinear model predictive control (CNMPC) scheme for controlling multiple micro aerial vehicles (MAVs). The control architecture uses an augmented state system to control multiple agents and performs both obstacle and collision avoidance. The optimization algorithm used is OpEn, based on the proximal averaged Newton type method for optimal control (PANOC) which provides fast convergence for non-convex optimization problems. The objective is to perform position reference tracking for each individual agent, while nonlinear constrains guarantee collision avoidance and smooth control signals. To produce a trajectory that satisfies all constraints a penalty method is applied to the nonlinear constraints. The efficacy of this proposed novel control scheme is successfully demonstrated through simulation results and comparisons, in terms of computation time and constraint violations, while are provided with respect to the number of agents.
△ Less
Submitted 2 September, 2021;
originally announced September 2021.
-
A Scalable Distributed Collision Avoidance Scheme for Multi-agent UAV systems
Authors:
Björn Lindqvist,
Pantelis Sopasakis,
George Nikolakopoulos
Abstract:
In this article we propose a distributed collision avoidance scheme for multi-agent unmanned aerial vehicles(UAVs) based on nonlinear model predictive control (NMPC),where other agents in the system are considered as dynamic obstacles with respect to the ego agent. Our control scheme operates at a low level and commands roll, pitch and thrust signals at a high frequency, each agent broadcasts its…
▽ More
In this article we propose a distributed collision avoidance scheme for multi-agent unmanned aerial vehicles(UAVs) based on nonlinear model predictive control (NMPC),where other agents in the system are considered as dynamic obstacles with respect to the ego agent. Our control scheme operates at a low level and commands roll, pitch and thrust signals at a high frequency, each agent broadcasts its predicted trajectory to the other ones, and we propose an obstacle prioritization scheme based on the shared trajectories to allow up-scaling of the system. The NMPC problem is solved using an ad hoc solver where PANOC is combined with an augmented Lagrangian method to compute collision-free trajectories. We evaluate the proposed scheme in several challenging laboratory experiments for up to ten aerial agents, in dense aerial swarms.
△ Less
Submitted 8 April, 2021;
originally announced April 2021.
-
Subterranean MAV Navigation based on Nonlinear MPC with Collision Avoidance Constraints
Authors:
Sina Sharif Mansouri,
Christoforos Kanellakis,
Emil Fresk,
Bjorn Lindqvist,
Dariusz Kominiak,
Anton Koval,
Pantelis Sopasakis,
George Nikolakopoulos
Abstract:
Micro Aerial Vehicles (MAVs) navigation in subterranean environments is gaining attention in the field of aerial robotics, however there are still multiple challenges for collision free navigation in such harsh environments. This article proposes a novel baseline solution for collision free navigation with Nonlinear Model Predictive Control (NMPC). In the proposed method, the MAV is considered as…
▽ More
Micro Aerial Vehicles (MAVs) navigation in subterranean environments is gaining attention in the field of aerial robotics, however there are still multiple challenges for collision free navigation in such harsh environments. This article proposes a novel baseline solution for collision free navigation with Nonlinear Model Predictive Control (NMPC). In the proposed method, the MAV is considered as a floating object, where the velocities on the $x$, $y$ axes and the position on altitude are the references for the NMPC to navigate along the tunnel, while the NMPC avoids the collision by considering kinematics of the obstacles based on measurements from a 2D lidar. Moreover, a novel approach for correcting the heading of the MAV towards the center of the mine tunnel is proposed, while the efficacy of the suggested framework has been evaluated in multiple field trials in an underground mine in Sweden.
△ Less
Submitted 7 June, 2020;
originally announced June 2020.
-
Visual Area Coverage with Attitude-Dependent Camera Footprints by Particle Harvesting
Authors:
Sina Sharif Mansouri,
Pantelis Sopasakis,
George Georgoulas,
Thomas Gustafsson,
George Nikolakopoulos
Abstract:
In aerial visual area coverage missions, the camera footprint changes over time based on the camera position and orientation -- a fact that complicates the whole process of coverage and path planning. This article proposes a solution to the problem of visual coverage by filling the target area with a set of randomly distributed particles and harvesting them by camera footprints. This way, high cov…
▽ More
In aerial visual area coverage missions, the camera footprint changes over time based on the camera position and orientation -- a fact that complicates the whole process of coverage and path planning. This article proposes a solution to the problem of visual coverage by filling the target area with a set of randomly distributed particles and harvesting them by camera footprints. This way, high coverage is obtained at a low computational cost. In this approach, the path planner considers six degrees of freedom (DoF) for the camera movement and commands thrust and attitude references to a lower layer controller, while maximizing the covered area and coverage quality. The proposed method requires a priori information of the boundaries of the target area and can handle areas of very complex and highly non-convex geometry. The effectiveness of the approach is demonstrated in multiple simulations in terms of computational efficiency and coverage.
△ Less
Submitted 15 September, 2019; v1 submitted 10 September, 2019;
originally announced September 2019.
