Showing 1–38 of 38 results for author: di Bernardo, M

Learning-based cognitive architecture for enhancing coordination in human groups

Authors: Antonio Grotta, Marco Coraggio, Antonio Spallone, Francesco De Lellis, Mario di Bernardo

Abstract: As interactions with autonomous agents-ranging from robots in physical settings to avatars in virtual and augmented realities-become more prevalent, develo** advanced cognitive architectures is critical for enhancing the dynamics of human-avatar groups. This paper presents a reinforcement-learning-based cognitive architecture, trained via a sim-to-real approach, designed to improve synchronizati… ▽ More As interactions with autonomous agents-ranging from robots in physical settings to avatars in virtual and augmented realities-become more prevalent, develo** advanced cognitive architectures is critical for enhancing the dynamics of human-avatar groups. This paper presents a reinforcement-learning-based cognitive architecture, trained via a sim-to-real approach, designed to improve synchronization in periodic motor tasks, crucial for applications in group rehabilitation and sports training. Extensive numerical validation consistently demonstrates improvements in synchronization. Theoretical derivations and numerical investigations are complemented by preliminary experiments with real participants, showing that our avatars can integrate seamlessly into human groups, often being indistinguishable from humans. △ Less

Submitted 10 June, 2024; originally announced June 2024.

Leader-Follower Density Control of Spatial Dynamics in Large-Scale Multi-Agent Systems

Authors: Gian Carlo Maffettone, Alain Boldini, Maurizio Porfiri, Mario di Bernardo

Abstract: We address the problem of controlling the density of a large ensemble of follower agents by acting on group of leader agents that interact with them. We formulate the problem as a system of coupled partial integro-differential equations describing for the dynamics of the leaders' and followers' densities. We define feasibility conditions and propose two control architectures for exponential global… ▽ More We address the problem of controlling the density of a large ensemble of follower agents by acting on group of leader agents that interact with them. We formulate the problem as a system of coupled partial integro-differential equations describing for the dynamics of the leaders' and followers' densities. We define feasibility conditions and propose two control architectures for exponential global stability. The first architecture is a feed-forward scheme for the followers. It adjusts the leaders' density via a feedback loop, which leverages information about leaders and a fixed reference density, to direct followers towards a target distribution. The second, dual feedback strategy employs a reference-governor to dynamically adapt the leaders' reference density based on measurements on both leaders and followers. Initially analyzed in one dimension, our methods are expanded to multi-dimensional applications. Numerical validations and an application in continuification-based control of leader-follower multiagent systems confirm the effectiveness of our approaches. △ Less

Submitted 3 June, 2024; originally announced June 2024.

High-dimensional continuification control of large-scale multi-agent systems under limited sensing and perturbations

Authors: Gian Carlo Maffettone, Mario di Bernardo, Maurizio Porfiri

Abstract: This paper investigates the robustness of a novel high-dimensional continuification control method for complex multi-agent systems. We begin by formulating a partial differential equation describing the spatio-temporal density dynamics of swarming agents. A stable control action for the density is then derived and validated under nominal conditions. Subsequently, we discretize this macroscopic str… ▽ More This paper investigates the robustness of a novel high-dimensional continuification control method for complex multi-agent systems. We begin by formulating a partial differential equation describing the spatio-temporal density dynamics of swarming agents. A stable control action for the density is then derived and validated under nominal conditions. Subsequently, we discretize this macroscopic strategy into actionable velocity inputs for the system's agents. Our analysis demonstrates the robustness of the approach beyond idealized assumptions of unlimited sensing and absence of perturbations. △ Less

Submitted 25 March, 2024; originally announced March 2024.

Comments: arXiv admin note: text overlap with arXiv:2310.01573

Data-driven architecture to encode information in the kinematics of robots and artificial avatars

Authors: Francesco De Lellis, Marco Coraggio, Nathan C. Foster, Riccardo Villa, Cristina Becchio, Mario di Bernardo

Abstract: We present a data-driven control architecture for modifying the kinematics of robots and artificial avatars to encode specific information such as the presence or not of an emotion in the movements of an avatar or robot driven by a human operator. We validate our approach on an experimental dataset obtained during the reach-to-grasp phase of a pick-and-place task. We present a data-driven control architecture for modifying the kinematics of robots and artificial avatars to encode specific information such as the presence or not of an emotion in the movements of an avatar or robot driven by a human operator. We validate our approach on an experimental dataset obtained during the reach-to-grasp phase of a pick-and-place task. △ Less

Submitted 11 March, 2024; originally announced March 2024.

In vivo learning-based control of microbial populations density in bioreactors

Authors: Sara Maria Brancato, Davide Salzano, Francesco De Lellis, Davide Fiore, Giovanni Russo, Mario di Bernardo

Abstract: A key problem toward the use of microorganisms as bio-factories is reaching and maintaining cellular communities at a desired density and composition so that they can efficiently convert their biomass into useful compounds. Promising technological platforms for the real time, scalable control of cellular density are bioreactors. In this work, we developed a learning-based strategy to expand the to… ▽ More A key problem toward the use of microorganisms as bio-factories is reaching and maintaining cellular communities at a desired density and composition so that they can efficiently convert their biomass into useful compounds. Promising technological platforms for the real time, scalable control of cellular density are bioreactors. In this work, we developed a learning-based strategy to expand the toolbox of available control algorithms capable of regulating the density of a \textit{single} bacterial population in bioreactors. Specifically, we used a sim-to-real paradigm, where a simple mathematical model, calibrated using a few data, was adopted to generate synthetic data for the training of the controller. The resulting policy was then exhaustively tested in vivo using a low-cost bioreactor known as Chi.Bio, assessing performance and robustness. In addition, we compared the performance with more traditional controllers (namely, a PI and an MPC), confirming that the learning-based controller exhibits similar performance in vivo. Our work showcases the viability of learning-based strategies for the control of cellular density in bioreactors, making a step forward toward their use for the control of the composition of microbial consortia. △ Less

Submitted 15 December, 2023; originally announced December 2023.

Comments: 13 pages, 4 figures

Guaranteeing Control Requirements via Reward Sha** in Reinforcement Learning

Authors: Francesco De Lellis, Marco Coraggio, Giovanni Russo, Mirco Musolesi, Mario di Bernardo

Abstract: In addressing control problems such as regulation and tracking through reinforcement learning, it is often required to guarantee that the acquired policy meets essential performance and stability criteria such as a desired settling time and steady-state error prior to deployment. Motivated by this necessity, we present a set of results and a systematic reward sha** procedure that (i) ensures the… ▽ More In addressing control problems such as regulation and tracking through reinforcement learning, it is often required to guarantee that the acquired policy meets essential performance and stability criteria such as a desired settling time and steady-state error prior to deployment. Motivated by this necessity, we present a set of results and a systematic reward sha** procedure that (i) ensures the optimal policy generates trajectories that align with specified control requirements and (ii) allows to assess whether any given policy satisfies them. We validate our approach through comprehensive numerical experiments conducted in two representative environments from OpenAI Gym: the Inverted Pendulum swing-up problem and the Lunar Lander. Utilizing both tabular and deep reinforcement learning methods, our experiments consistently affirm the efficacy of our proposed framework, highlighting its effectiveness in ensuring policy adherence to the prescribed control requirements. △ Less

Submitted 20 March, 2024; v1 submitted 16 November, 2023; originally announced November 2023.

Mixed Reality Environment and High-Dimensional Continuification Control for Swarm Robotics

Authors: Gian Carlo Maffettone, Lorenzo Liguori, Eduardo Palermo, Mario di Bernardo, Maurizio Porfiri

Abstract: Many new methodologies for the control of large-scale multi-agent systems are based on macroscopic representations of the emerging systemdynamics, in the form of continuum approximations of large ensembles. These techniques, that are typically developed in the limit case of an infinite number of agents, are usually validated only through numerical simulations. In this paper, we introduce a mixed r… ▽ More Many new methodologies for the control of large-scale multi-agent systems are based on macroscopic representations of the emerging systemdynamics, in the form of continuum approximations of large ensembles. These techniques, that are typically developed in the limit case of an infinite number of agents, are usually validated only through numerical simulations. In this paper, we introduce a mixed reality set-up for testing swarm robotics techniques, focusing on the macroscopic collective motion of robotic swarms. This hybrid apparatus combines both real differential drive robots and virtual agents to create a heterogeneous swarm of tunable size. We also extend continuification-based control methods for swarms to higher dimensions, and assess experimentally their validity in the new platform. Our study demonstrates the effectiveness of the platform for conducting large-scale swarm robotics experiments, and it contributes new theoretical insights into control algorithms exploiting continuification approaches. △ Less

Submitted 13 March, 2024; v1 submitted 2 October, 2023; originally announced October 2023.

Data-driven design of complex network structures to promote synchronization

Authors: Marco Coraggio, Mario di Bernardo

Abstract: We consider the problem of optimizing the interconnection graphs of complex networks to promote synchronization. When traditional optimization methods are inapplicable, due to uncertain or unknown node dynamics, we propose a data-driven approach leveraging datasets of relevant examples. We analyze two case studies, with linear and nonlinear node dynamics. First, we show how including node dynamics… ▽ More We consider the problem of optimizing the interconnection graphs of complex networks to promote synchronization. When traditional optimization methods are inapplicable, due to uncertain or unknown node dynamics, we propose a data-driven approach leveraging datasets of relevant examples. We analyze two case studies, with linear and nonlinear node dynamics. First, we show how including node dynamics in the objective function makes the optimal graphs heterogeneous. Then, we compare various design strategies, finding that the best either utilize data samples close to a specific Pareto front or a combination of a neural network and a genetic algorithm, with statistically better performance than the best examples in the datasets. △ Less

Submitted 28 September, 2023; v1 submitted 19 September, 2023; originally announced September 2023.

Shepherding control and herdability in complex multiagent systems

Authors: Andrea Lama, Mario di Bernardo

Abstract: We study the shepherding control problem where a group of "herders" need to orchestrate their collective behaviour in order to steer the dynamics of a group of "target" agents towards a desired goal. We relax the strong assumptions of targets showing cohesive collective behavior in the absence of the herders, and herders owning global sensing capabilities. We find scaling laws linking the number o… ▽ More We study the shepherding control problem where a group of "herders" need to orchestrate their collective behaviour in order to steer the dynamics of a group of "target" agents towards a desired goal. We relax the strong assumptions of targets showing cohesive collective behavior in the absence of the herders, and herders owning global sensing capabilities. We find scaling laws linking the number of targets and minimum herders needed, and we unveil the existence of a critical threshold of the density of the targets, below which the number of herders needed for success significantly increases. We explain the existence of such a threshold in terms of the percolation of a suitably defined herdability graph and support our numerical evidence by deriving and analysing a PDE describing the herders dynamics in a simplified one-dimensional setting. Extensive numerical experiments validate our methodology. △ Less

Submitted 21 February, 2024; v1 submitted 31 July, 2023; originally announced July 2023.

Preliminary results on the herdability of complex multiagent systems via local information

Authors: Andrea Lama, Mario Di Bernardo

Abstract: We present preliminary results on the problem of driving the dynamics of a group of agents, the herders, so as to steer the collective behaviour of another group of agents, the targets, interacting with them. We define this problem as the multiagent herding control problem and study the herdability of the target agents by relaxing some strong assumptions often made in the existing literature, name… ▽ More We present preliminary results on the problem of driving the dynamics of a group of agents, the herders, so as to steer the collective behaviour of another group of agents, the targets, interacting with them. We define this problem as the multiagent herding control problem and study the herdability of the target agents by relaxing some strong assumptions often made in the existing literature, namely that targets are cohesive in the absence of herders and that herders possess global information. We find that scaling laws exist linking crucial parameters such as the herders' sensing radius and the targets density with the herdability of the system. Our most surprising observation, supported by exhaustive numerical experiments, is that the crucial effect of limited sensing is that the minimum number of herders required to solve the problem significantly increases below a critical minimum density of the target agents. △ Less

Submitted 1 August, 2023; v1 submitted 22 April, 2023; originally announced April 2023.

Comments: An updated version is available at arXiv:2307.16797

Continuification control of large-scale multiagent systems under limited sensing and structural perturbations

Authors: Gian Carlo Maffettone, Maurizio Porfiri, Mario di Bernardo

Abstract: We investigate the stability and robustness properties of a continuification-based strategy for the control of large-scale multiagent systems. Within continuation-based strategy, one transforms the microscopic, agent-level description of the system dynamics into a macroscopic continuum-level, for which a control action can be synthesized to steer the macroscopic dynamics towards a desired distribu… ▽ More We investigate the stability and robustness properties of a continuification-based strategy for the control of large-scale multiagent systems. Within continuation-based strategy, one transforms the microscopic, agent-level description of the system dynamics into a macroscopic continuum-level, for which a control action can be synthesized to steer the macroscopic dynamics towards a desired distribution. Such an action is ultimately discretized to obtain a set of deployable control inputs for the agents to achieve the goal. The mathematical proof of convergence toward the desired distribution typically relies on the assumptions that no disturbance is present and that each agent possesses global knowledge of all the others' positions. Here, we analytically and numerically address the possibility of relaxing these assumptions for the case of a one-dimensional system of agents moving in a ring. We offer compelling evidence in favor of the use of a continuification-based strategy when agents only possess a finite sensing capability and spatio-temporal perturbations affect the macroscopic dynamics of the ensemble. We also discuss some preliminary results about the role of an integral action in the macroscopic control solution. △ Less

Submitted 23 March, 2023; originally announced March 2023.

Local convergence of multi-agent systems towards triangular patterns

Authors: Andrea Giusti, Marco Coraggio, Mario di Bernardo

Abstract: Geometric pattern formation is an important emergent behavior in many applications involving large-scale multi-agent systems, such as sensor networks deployment and collective transportation. Attraction/repulsion virtual forces are the most common control approach to achieve such behavior in a distributed and scalable manner. Nevertheless, for most existing solutions only numerical and/or experime… ▽ More Geometric pattern formation is an important emergent behavior in many applications involving large-scale multi-agent systems, such as sensor networks deployment and collective transportation. Attraction/repulsion virtual forces are the most common control approach to achieve such behavior in a distributed and scalable manner. Nevertheless, for most existing solutions only numerical and/or experimental evidence of their convergence is available. Here, we revisit the problem of achieving pattern formation giving sufficient conditions to prove analytically that under the influence of appropriate virtual forces, a large-scale multi-agent swarming system locally converges towards a stable and robust triangular lattice configuration. Specifically, the proof is carried out using LaSalle's invariance principle and geometry-based arguments. Our theoretical results are complemented by exhaustive numerical simulations confirming their effectiveness and estimating the region of asymptotic stability of the triangular configuration. △ Less

Submitted 21 March, 2023; originally announced March 2023.

MSC Class: 93A16

Consensus-based Distributed Intentional Controlled Islanding of Power Grids

Authors: Francesco Lo Iudice, Ricardo Cardona-Rivera, Antonio Grotta, Marco Coraggio, Mario di Bernardo

Abstract: The problem of partitioning a power grid into a set of islands can be a solution to restore power dispatchment in sections of a grid affected by an extreme failure. Current solutions to this problem usually involve finding the partition of the grid into islands that minimizes the sum of their absolute power imbalances. This combinatorial problem is often solved through heuristic offline methods. I… ▽ More The problem of partitioning a power grid into a set of islands can be a solution to restore power dispatchment in sections of a grid affected by an extreme failure. Current solutions to this problem usually involve finding the partition of the grid into islands that minimizes the sum of their absolute power imbalances. This combinatorial problem is often solved through heuristic offline methods. In this paper, we propose instead a distributed online algorithm through which nodes can migrate among islands, self-organizing the network into a suitable partition. We prove that, under a set of appropriate assumptions, the proposed solution yields a partition whose absolute power imbalance falls within a given bound of the optimal solution. We validate our analytical results by testing our partitioning strategy on the IEEE 118 and 300 benchmark problems. △ Less

Submitted 3 January, 2023; originally announced January 2023.

CT-DQN: Control-Tutored Deep Reinforcement Learning

Authors: Francesco De Lellis, Marco Coraggio, Giovanni Russo, Mirco Musolesi, Mario di Bernardo

Abstract: One of the major challenges in Deep Reinforcement Learning for control is the need for extensive training to learn the policy. Motivated by this, we present the design of the Control-Tutored Deep Q-Networks (CT-DQN) algorithm, a Deep Reinforcement Learning algorithm that leverages a control tutor, i.e., an exogenous control law, to reduce learning time. The tutor can be designed using an approxima… ▽ More One of the major challenges in Deep Reinforcement Learning for control is the need for extensive training to learn the policy. Motivated by this, we present the design of the Control-Tutored Deep Q-Networks (CT-DQN) algorithm, a Deep Reinforcement Learning algorithm that leverages a control tutor, i.e., an exogenous control law, to reduce learning time. The tutor can be designed using an approximate model of the system, without any assumption about the knowledge of the system's dynamics. There is no expectation that it will be able to achieve the control objective if used stand-alone. During learning, the tutor occasionally suggests an action, thus partially guiding exploration. We validate our approach on three scenarios from OpenAI Gym: the inverted pendulum, lunar lander, and car racing. We demonstrate that CT-DQN is able to achieve better or equivalent data efficiency with respect to the classic function approximation solutions. △ Less

Submitted 2 December, 2022; originally announced December 2022.

Continuification-based control of large multiagent systems in a ring

Authors: Gian Carlo Maffettone, Alain Boldini, Mario di Bernardo, Maurizio Porfiri

Abstract: In this paper, we propose a method to control large-scale multiagent systems swarming in a ring. Specifically, we use a continuification-based approach that transforms the microscopic, agent-level description of the system dynamics into a macroscopic, continuum-level representation, which we employ to synthesize a control action towards a desired distribution of the agents. The continuum-level con… ▽ More In this paper, we propose a method to control large-scale multiagent systems swarming in a ring. Specifically, we use a continuification-based approach that transforms the microscopic, agent-level description of the system dynamics into a macroscopic, continuum-level representation, which we employ to synthesize a control action towards a desired distribution of the agents. The continuum-level control action is then discretized at the agent-level in order to practically implement it. To confirm the effectiveness and the robustness of the proposed approach, we complement theoretical derivations with a series of numerical simulations. △ Less

Submitted 29 September, 2022; originally announced September 2022.

External control of a genetic toggle switch via Reinforcement Learning

Authors: Sara Maria Brancato, Francesco De Lellis, Davide Salzano, Giovanni Russo, Mario di Bernardo

Abstract: We investigate the problem of using a learning-based strategy to stabilize a synthetic toggle switch via an external control approach. To overcome the data efficiency problem that would render the algorithm unfeasible for practical use in synthetic biology, we adopt a sim-to-real paradigm where the policy is learnt via training on a simplified model of the toggle switch and it is then subsequently… ▽ More We investigate the problem of using a learning-based strategy to stabilize a synthetic toggle switch via an external control approach. To overcome the data efficiency problem that would render the algorithm unfeasible for practical use in synthetic biology, we adopt a sim-to-real paradigm where the policy is learnt via training on a simplified model of the toggle switch and it is then subsequently exploited to control a more realistic model of the switch parameterized from in-vivo experiments. Our in-silico experiments confirm the viability of the approach suggesting its potential use for in-vivo control implementations. △ Less

Submitted 11 April, 2022; originally announced April 2022.

Minimax Flow over Acyclic Networks: Distributed Algorithms and Microgrid Application

Authors: Marco Coraggio, Saber Jafarpour, Francesco Bullo, Mario di Bernardo

Abstract: Given a flow network with variable suppliers and fixed consumers, the minimax flow problem consists in minimizing the maximum flow between nodes, subject to flow conservation and capacity constraints. We solve this problem over acyclic graphs in a distributed manner by showing that it can be recast as a consensus problem between the maximum downstream flows, which we define here for the first time… ▽ More Given a flow network with variable suppliers and fixed consumers, the minimax flow problem consists in minimizing the maximum flow between nodes, subject to flow conservation and capacity constraints. We solve this problem over acyclic graphs in a distributed manner by showing that it can be recast as a consensus problem between the maximum downstream flows, which we define here for the first time. Additionally, we present a distributed algorithm to estimate these quantities. Finally, exploiting our theoretical results, we design an online distributed controller to prevent overcurrent in microgrids consisting of loads and droop-controlled inverters. Our results are validated numerically on the CIGRE benchmark microgrid. △ Less

Submitted 9 July, 2022; v1 submitted 10 January, 2022; originally announced January 2022.

Control-Tutored Reinforcement Learning: Towards the Integration of Data-Driven and Model-Based Control

Authors: F. De Lellis, M. Coraggio, G. Russo, M. Musolesi, M. di Bernardo

Abstract: We present an architecture where a feedback controller derived on an approximate model of the environment assists the learning process to enhance its data efficiency. This architecture, which we term as Control-Tutored Q-learning (CTQL), is presented in two alternative flavours. The former is based on defining the reward function so that a Boolean condition can be used to determine when the contro… ▽ More We present an architecture where a feedback controller derived on an approximate model of the environment assists the learning process to enhance its data efficiency. This architecture, which we term as Control-Tutored Q-learning (CTQL), is presented in two alternative flavours. The former is based on defining the reward function so that a Boolean condition can be used to determine when the control tutor policy is adopted, while the latter, termed as probabilistic CTQL (pCTQL), is instead based on executing calls to the tutor with a certain probability during learning. Both approaches are validated, and thoroughly benchmarked against Q-Learning, by considering the stabilization of an inverted pendulum as defined in OpenAI Gym as a representative problem. △ Less

Submitted 11 December, 2021; originally announced December 2021.

Adaptive and quasi-sliding control of shimmy in landing gears

Authors: Daniel A. Burbano-Lombana, Marco Coraggio, Mario di Bernardo, Franco Garofalo, Michele Pugliese

Abstract: Shimmy is a dangerous phenomenon that occurs when aircraft's nose landing gears oscillate in a rapid and uncontrollable fashion. In this paper, we propose the use of two nonlinear control approaches (zero average control and model reference adaptive control based on minimal control synthesis) as simple yet effective strategies to suppress undesired oscillations, even in the presence of uncertainti… ▽ More Shimmy is a dangerous phenomenon that occurs when aircraft's nose landing gears oscillate in a rapid and uncontrollable fashion. In this paper, we propose the use of two nonlinear control approaches (zero average control and model reference adaptive control based on minimal control synthesis) as simple yet effective strategies to suppress undesired oscillations, even in the presence of uncertainties and partial state measurements. Numerical results are presented to validate the proposed control approaches. △ Less

Submitted 12 November, 2021; originally announced November 2021.

Synchronization of networks of piecewise-smooth systems

Authors: Marco Coraggio, Pietro DeLellis, S. John Hogan, Mario di Bernardo

Abstract: We study convergence in networks of piecewise-smooth (PWS) systems that commonly arise in applications to model dynamical systems whose evolution is affected by macroscopic events such as switches and impacts. Existing approaches were typically oriented toward guaranteeing global bounded synchronizability, local stability of the synchronization manifold, or achieving synchronization by exerting a… ▽ More We study convergence in networks of piecewise-smooth (PWS) systems that commonly arise in applications to model dynamical systems whose evolution is affected by macroscopic events such as switches and impacts. Existing approaches were typically oriented toward guaranteeing global bounded synchronizability, local stability of the synchronization manifold, or achieving synchronization by exerting a control action on each node. Here we start by generalizing existing results on QUAD systems to the case of PWS systems, accounting for a large variety of nonlinear coupling laws. Then, we propose that a discontinuous coupling can be used to guarantee global synchronizability of a network of N PWS agents under mild assumptions on the individual dynamics. We provide extensive numerical simulations to gain insights on larger networks. △ Less

Submitted 12 November, 2021; originally announced November 2021.

Utilizing synchronization to partition power networks into microgrids

Authors: Ricardo Cardona-Rivera, Francesco Lo Iudice, Antonio Grotta, Marco Coraggio, Mario di Bernardo

Abstract: The problem of partitioning a power grid into a set of microgrids, or islands, is of interest for both the design of future smart grids, and as a last resort to restore power dispatchment in sections of a grid affected by an extreme failure. In the literature this problem is usually solved by turning it into a combinatorial optimization problem, often solved through generic heruristic methods such… ▽ More The problem of partitioning a power grid into a set of microgrids, or islands, is of interest for both the design of future smart grids, and as a last resort to restore power dispatchment in sections of a grid affected by an extreme failure. In the literature this problem is usually solved by turning it into a combinatorial optimization problem, often solved through generic heruristic methods such as Genetic Algorithms or Tabu Search. In this paper, we take a different route and obtain the grid partition by exploiting the synchronization dynamics of a cyberlayer of Kuramoto oscillators, each parameterized as a rough approximation of the dynamics of the grid's node it corresponds to. We present first a centralised algorithm and then a decentralised strategy. In the former, nodes are aggregated based on their internode synchronization times while in the latter they exploit synchronization of the oscillators in the cyber layer to selforganise into islands. Our preliminary results show that the heuristic synchronization based algorithms do converge towards partitions that are comparable to those obtained via other more cumbersome and computationally expensive optimization-based methods. △ Less

Submitted 26 July, 2021; originally announced July 2021.

Comments: 6 pages, 4 figures

MSC Class: 93-08 ACM Class: G.1.6; G.2.2; I.2.8

Intermittent non-pharmaceutical strategies to mitigate the COVID-19 epidemic in a network model of Italy via constrained optimization

Authors: Marco Coraggio, Shihao Xie, Francesco De Lellis, Giovanni Russo, Mario di Bernardo

Abstract: This paper is concerned with the design of intermittent non-pharmaceutical strategies to mitigate the spread of the COVID-19 epidemic exploiting network epidemiological models. Specifically, by studying a variational equation for the dynamics of the infected in a network model of the epidemic spread, we derive, using contractivity arguments, a condition that can be used to guarantee that, in epide… ▽ More This paper is concerned with the design of intermittent non-pharmaceutical strategies to mitigate the spread of the COVID-19 epidemic exploiting network epidemiological models. Specifically, by studying a variational equation for the dynamics of the infected in a network model of the epidemic spread, we derive, using contractivity arguments, a condition that can be used to guarantee that, in epidemiological terms, the effective reproduction number is less than unity. This condition has three advantages: (i) it is easily computable; (ii) it is directly related to the model parameters; (iii) it can be used to enforce a scalability condition that prohibits the amplification of disturbances within the network system. We then include satisfaction of such a condition as a constraint in a Model Predictive Control problem so as to mitigate (or suppress) the spread of the epidemic while minimizing the economic impact of the interventions. A data-driven model of Italy as a network of three macro-regions (North, Center, and South), whose parameters are identified from real data, is used to illustrate and evaluate the effectiveness of the proposed control strategy. △ Less

Submitted 4 October, 2021; v1 submitted 25 March, 2021; originally announced March 2021.

Comments: Accepted by Control and Decision Conference 2021

Tutoring Reinforcement Learning via Feedback Control

Authors: Francesco De Lellis, Giovanni Russo, Mario di Bernardo

Abstract: We introduce a control-tutored reinforcement learning (CTRL) algorithm. The idea is to enhance tabular learning algorithms by means of a control strategy with limited knowledge of the system model. By tutoring the learning process, the learning rate can be substantially reduced. We use the classical problem of stabilizing an inverted pendulum as a benchmark to numerically illustrate the advantages… ▽ More We introduce a control-tutored reinforcement learning (CTRL) algorithm. The idea is to enhance tabular learning algorithms by means of a control strategy with limited knowledge of the system model. By tutoring the learning process, the learning rate can be substantially reduced. We use the classical problem of stabilizing an inverted pendulum as a benchmark to numerically illustrate the advantages and disadvantages of the approach. △ Less

Submitted 12 December, 2020; originally announced December 2020.

Distributed Discontinuous Coupling for Convergence in Networks of Heterogeneous Nonlinear Systems

Authors: Marco Coraggio, Pietro DeLellis, Mario di Bernardo

Abstract: Synchronization is a crucial phenomenon in many natural and artificial complex network systems. Applications include neuronal networks, formation control and coordination in robotics, and frequency synchronization in electrical power grids. In this paper, we propose the use of a distributed discontinuous coupling protocol to achieve convergence and synchronization in networks of non-identical nonl… ▽ More Synchronization is a crucial phenomenon in many natural and artificial complex network systems. Applications include neuronal networks, formation control and coordination in robotics, and frequency synchronization in electrical power grids. In this paper, we propose the use of a distributed discontinuous coupling protocol to achieve convergence and synchronization in networks of non-identical nonlinear dynamical systems. We show that the synchronous dynamics is a solution to the average of the nodes' vector fields, and derive analytical estimates of the critical coupling gains required to achieve convergence. Numerical simulations are used to illustrate and validate the theoretical results. △ Less

Submitted 23 March, 2020; originally announced March 2020.

Control-Tutored Reinforcement Learning

Authors: Francesco De Lellis, Fabrizia Auletta, Giovanni Russo, Piero De Lellis, Mario di Bernardo

Abstract: We introduce a control-tutored reinforcement learning (CTRL) algorithm. The idea is to enhance tabular learning algorithms so as to improve the exploration of the state-space, and substantially reduce learning times by leveraging some limited knowledge of the plant encoded into a tutoring model-based control strategy. We illustrate the benefits of our novel approach and its effectiveness by using… ▽ More We introduce a control-tutored reinforcement learning (CTRL) algorithm. The idea is to enhance tabular learning algorithms so as to improve the exploration of the state-space, and substantially reduce learning times by leveraging some limited knowledge of the plant encoded into a tutoring model-based control strategy. We illustrate the benefits of our novel approach and its effectiveness by using the problem of controlling one or more agents to herd and contain within a goal region a set of target free-roving agents in the plane. △ Less

Submitted 12 December, 2019; originally announced December 2019.

Control of Painlevé Paradox in a Robotic System

Authors: Davide Marchese, Marco Coraggio, S. John Hogan, Mario di Bernardo

Abstract: The Painlevé paradox is a phenomenon that causes instability in mechanical systems subjects to unilateral constraints. While earlier studies were mostly focused on abstract theoretical settings, recent work confirmed the occurrence of the paradox in realistic set-ups. In this paper, we investigate the dynamics and presence of the Painlevé phenomenon in a twolinks robot in contact with a moving bel… ▽ More The Painlevé paradox is a phenomenon that causes instability in mechanical systems subjects to unilateral constraints. While earlier studies were mostly focused on abstract theoretical settings, recent work confirmed the occurrence of the paradox in realistic set-ups. In this paper, we investigate the dynamics and presence of the Painlevé phenomenon in a twolinks robot in contact with a moving belt, through a bifurcation study. Then, we use the results of this analysis to inform the design of control strategies able to keep the robot sliding on the belt and avoid the onset of undesired lift-off. To this aim, through numerical simulations, we synthesise and compare a PID strategy and a hybrid force/motion control scheme, finding that the latter is able to guarantee better performance and avoid the onset of bouncing motion due to the Painlevé phenomenon. △ Less

Submitted 9 July, 2019; originally announced July 2019.

Convergence and Synchronization in Networks of Piecewise-Smooth Systems via Distributed Discontinuous Coupling

Authors: Marco Coraggio, Pietro DeLellis, Mario di Bernardo

Abstract: Complex networks are a successful framework to describe collective behaviour in many applications, but a notable gap remains in the current literature, that of proving asymptotic convergence in networks of piecewise-smooth systems. Indeed, a wide variety of physical systems display discontinuous dynamics that change abruptly, including dry friction mechanical oscillators, electrical power converte… ▽ More Complex networks are a successful framework to describe collective behaviour in many applications, but a notable gap remains in the current literature, that of proving asymptotic convergence in networks of piecewise-smooth systems. Indeed, a wide variety of physical systems display discontinuous dynamics that change abruptly, including dry friction mechanical oscillators, electrical power converters, and biological neurons. In this paper, we study how to enforce global asymptotic state-synchronization in these networks. Specifically, we propose the addition of a distributed discontinuous coupling action to the commonly used diffusive coupling protocol. Moreover, we provide analytical estimates of the thresholds on the coupling gains required for convergence, and highlight the importance of a new connectivity measure, which we named minimum density. The theoretical results are illustrated by a set of representative examples. △ Less

Submitted 2 December, 2020; v1 submitted 14 May, 2019; originally announced May 2019.

Ratiometric control for differentiation of cell populations endowed with synthetic toggle switches

Authors: Davide Salzano, Davide Fiore, Mario di Bernardo

Abstract: We consider the problem of regulating by means of external control inputs the ratio of two cell populations. Specifically, we assume that these two cellular populations are composed of cells belonging to the same strain which embeds some bistable memory mechanism, e.g. a genetic toggle switch, allowing them to switch role from one population to another in response to some inputs. We present three… ▽ More We consider the problem of regulating by means of external control inputs the ratio of two cell populations. Specifically, we assume that these two cellular populations are composed of cells belonging to the same strain which embeds some bistable memory mechanism, e.g. a genetic toggle switch, allowing them to switch role from one population to another in response to some inputs. We present three control strategies to regulate the populations' ratio to arbitrary desired values which take also into account realistic physical and technological constraints occurring in experimental microfluidic platforms. The designed controllers are then validated in-silico using stochastic agent-based simulations. △ Less

Submitted 12 September, 2019; v1 submitted 22 March, 2019; originally announced March 2019.

Comments: Accepted to CDC'2019

Journal ref: in Proc. of the IEEE 58th Conference on Decision and Control, 2019, pp. 927-932

In-silico Feedback Control of a MIMO Synthetic Toggle Switch via Pulse-Width Modulation

Authors: Agostino Guarino, Davide Fiore, Mario di Bernardo

Abstract: The synthetic toggle switch, first proposed by Gardner & Collins [1] is a MIMO control system that can be controlled by varying the concentrations of two inducer molecules, aTc and IPTG, to achieve a desired level of expression of the two genes it comprises. It has been shown [2] that this can be accomplished through an open-loop external control strategy where the two inputs are selected as mutua… ▽ More The synthetic toggle switch, first proposed by Gardner & Collins [1] is a MIMO control system that can be controlled by varying the concentrations of two inducer molecules, aTc and IPTG, to achieve a desired level of expression of the two genes it comprises. It has been shown [2] that this can be accomplished through an open-loop external control strategy where the two inputs are selected as mutually exclusive periodic pulse waves of appropriate amplitude and duty-cycle. In this paper, we use a recently derived average model of the genetic toggle switch subject to these inputs to synthesize new feedback control approaches that adjust the inputs duty-cycle in real-time via two different possible strategies, a model based hybrid PI-PWM approach and a so-called Zero-Average dynamics (ZAD) controller. The controllers are validated in-silico via both deterministic and stochastic simulations (SSA) illustrating the advantages and limitations of each strategy △ Less

Submitted 15 November, 2018; originally announced November 2018.

Comments: Preprint Submitted to ECC 2019

Journal ref: Proc. of the 18th European Control Conference, Naples, Italy, 2019, pp. 680-685

Using learning to control artificial avatars in human motor coordination tasks

Authors: Maria Lombardi, Davide Liuzza, Mario di Bernardo

Abstract: Designing artificial cyber-agents able to interact with human safely, smartly and in a natural way is a current open problem in control. Solving such an issue will allow the design of cyber-agents capable of co-operatively interacting with people in order to fulfil common joint tasks in a multitude of different applications. This is particularly relevant in the context of healthcare applications.… ▽ More Designing artificial cyber-agents able to interact with human safely, smartly and in a natural way is a current open problem in control. Solving such an issue will allow the design of cyber-agents capable of co-operatively interacting with people in order to fulfil common joint tasks in a multitude of different applications. This is particularly relevant in the context of healthcare applications. Indeed, the use has been proposed of artificial agents interacting and coordinating their movements with those of a patient suffering from social or motor disorders. Specifically, it has been shown that an artificial agent exhibiting certain kinematic properties could provide innovative and efficient rehabilitation strategies for these patients. Moreover, it has also been shown that the level of motor coordination is enhanced if these kinematic properties are similar to those of the individual it is interacting with. In this paper we discuss, first, a new method based on Markov Chains to confer "human motor characteristics" on a virtual agent, so as that it can coordinate its motion with that of a target individual while exhibiting specific kinematic properties. Then, we embed such synthetic model in a control architecture based on reinforcement learning to synthesize a cyber-agent able to mimic the behaviour of a specific human performing a joint motor task with one or more individuals. △ Less

Submitted 17 June, 2020; v1 submitted 9 October, 2018; originally announced October 2018.

Comments: 16 pages, 13 figures

Analysis and control of genetic toggle switches subject to periodic multi-input stimulation

Authors: Davide Fiore, Agostino Guarino, Mario di Bernardo

Abstract: In this letter, we analyze a genetic toggle switch recently studied in the literature where the expression of two repressor proteins can be tuned by controlling two different inputs, namely the concentration of two inducer molecules in the growth medium of the cells. Specifically, we investigate the dynamics of this system when subject to pulse-width modulated (PWM) input. We provide an analytical… ▽ More In this letter, we analyze a genetic toggle switch recently studied in the literature where the expression of two repressor proteins can be tuned by controlling two different inputs, namely the concentration of two inducer molecules in the growth medium of the cells. Specifically, we investigate the dynamics of this system when subject to pulse-width modulated (PWM) input. We provide an analytical model that captures qualitatively the experimental observations reported in the literature and approximates its asymptotic behavior. We also discuss the effect that the system parameters have on the prediction accuracy of the model. Moreover, we propose a possible external control strategy to regulate the mean value of the fluorescence of the reporter proteins when the cells are subject to such periodic forcing. △ Less

Submitted 4 September, 2018; v1 submitted 6 June, 2018; originally announced June 2018.

Comments: Preprint accepted for publication on L-CSS (First submission 31.05.2018, accepted 21.08.2018)

Journal ref: IEEE Control Systems Letters, vol. 3, no. 2, pp. 278-283, 2019

Observer design for piecewise smooth and switched systems via contraction theory

Authors: Davide Fiore, Marco Coraggio, Mario di Bernardo

Abstract: The aim of this paper is to present the application of an approach to study contraction theory recently developed for piecewise smooth and switched systems. The approach that can be used to analyze incremental stability properties of so-called Filippov systems (or variable structure systems) is based on the use of regularization, a procedure to make the vector field of interest differentiable befo… ▽ More The aim of this paper is to present the application of an approach to study contraction theory recently developed for piecewise smooth and switched systems. The approach that can be used to analyze incremental stability properties of so-called Filippov systems (or variable structure systems) is based on the use of regularization, a procedure to make the vector field of interest differentiable before analyzing its properties. We show that by using this extension of contraction theory to nondifferentiable vector fields, it is possible to design observers for a large class of piecewise smooth systems using not only Euclidean norms, as also done in previous literature, but also non-Euclidean norms. This allows greater flexibility in the design and encompasses the case of both piecewise-linear and piecewise-smooth (nonlinear) systems. The theoretical methodology is illustrated via a set of representative examples. △ Less

Submitted 7 April, 2017; v1 submitted 8 November, 2016; originally announced November 2016.

Comments: Preprint accepted to IFAC World Congress 2017

Journal ref: IFAC-PapersOnLine, vol. 50, no. 1, pp. 2959-2964, 2017

Improved Control Strategies for Intermittent Contact Mode Atomic Force Microscopes

Authors: Marco Coraggio, Martin Homer, Oliver D. Payton, Mario di Bernardo

Abstract: Atomic force microscopes have proved to be fundamental research tools in many situations where a gentle imaging process is required, and in a variety of environmental conditions, such as the study of biological samples. Among the possible modes of operation, intermittent contact mode is one that causes less wear to both the sample and the instrument; therefore, it is ideal when imaging soft sample… ▽ More Atomic force microscopes have proved to be fundamental research tools in many situations where a gentle imaging process is required, and in a variety of environmental conditions, such as the study of biological samples. Among the possible modes of operation, intermittent contact mode is one that causes less wear to both the sample and the instrument; therefore, it is ideal when imaging soft samples. However, intermittent contact mode is not particularly fast when compared to other imaging strategies. In this paper, we introduce three enhanced control approaches, applied at both the dither and z-axis piezos, to address the limitations of existing control schemes. Our proposed strategies are able to eliminate different image artefacts, automatically adapt scan speed to the sample being scanned and predict its features in real time. The result is that both the image quality and the scan time are improved. △ Less

Submitted 16 September, 2016; originally announced September 2016.

Comments: 11 pages

Exploiting nodes symmetries to control synchronization and consensus patterns in multiagent systems

Authors: Davide Fiore, Giovanni Russo, Mario di Bernardo

Abstract: We present new conditions to obtain synchronization and consensus patterns in complex network systems. The key idea is to exploit symmetries of the nodes' vector fields to induce a desired synchronization/consensus pattern, where nodes are clustered in different groups each converging towards a different synchronized evolution. We show that the new conditions we present offer a systematic methodol… ▽ More We present new conditions to obtain synchronization and consensus patterns in complex network systems. The key idea is to exploit symmetries of the nodes' vector fields to induce a desired synchronization/consensus pattern, where nodes are clustered in different groups each converging towards a different synchronized evolution. We show that the new conditions we present offer a systematic methodology to design a distributed network controller able to drive a network of interest towards a desired synchronization/consensus pattern. △ Less

Submitted 21 June, 2017; v1 submitted 1 March, 2016; originally announced March 2016.

Comments: Preprint accepted for publication on IEEE L-CSS

Journal ref: IEEE Control Systems Letters, vol. 1, no. 2, pp. 364-369, 2017

Switching control for incremental stabilization of nonlinear systems via contraction theory

Authors: Mario di Bernardo, Davide Fiore

Abstract: In this paper we present a switching control strategy to incrementally stabilize a class of nonlinear dynamical systems. Exploiting recent results on contraction analysis of switched Filippov systems derived using regularization, sufficient conditions are presented to prove incremental stability of the closed-loop system. Furthermore, based on these sufficient conditions, a design procedure is pro… ▽ More In this paper we present a switching control strategy to incrementally stabilize a class of nonlinear dynamical systems. Exploiting recent results on contraction analysis of switched Filippov systems derived using regularization, sufficient conditions are presented to prove incremental stability of the closed-loop system. Furthermore, based on these sufficient conditions, a design procedure is proposed to design a switched control action that is active only where the open-loop system is not sufficiently incrementally stable in order to reduce the required control effort. The design procedure to either locally or globally incrementally stabilize a dynamical system is then illustrated by means of a representative example. △ Less

Submitted 5 April, 2016; v1 submitted 28 October, 2015; originally announced October 2015.

Comments: Accepted to ECC 2016

Journal ref: 2016 European Control Conference (ECC), Aalborg, 2016, pp. 2054-2059

Contraction analysis of switched Filippov systems via regularization

Authors: Mario di Bernardo, Davide Fiore, S. John Hogan

Abstract: We study incremental stability and convergence of switched (bimodal) Filippov systems via contraction analysis. In particular, by using results on regularization of switched dynamical systems, we derive sufficient conditions for convergence of any two trajectories of the Filippov system between each other within some region of interest. We then apply these conditions to the study of different clas… ▽ More We study incremental stability and convergence of switched (bimodal) Filippov systems via contraction analysis. In particular, by using results on regularization of switched dynamical systems, we derive sufficient conditions for convergence of any two trajectories of the Filippov system between each other within some region of interest. We then apply these conditions to the study of different classes of Filippov systems including piecewise smooth (PWS) systems, piecewise affine (PWA) systems and relay feedback systems. We show that contrary to previous approaches, our conditions allow the system to be studied in metrics other than the Euclidean norm. The theoretical results are illustrated by numerical simulations on a set of representative examples that confirm their effectiveness and ease of application. △ Less

Submitted 27 June, 2017; v1 submitted 25 July, 2015; originally announced July 2015.

Comments: Preprint submitted to Automatica

Journal ref: Automatica, vol. 73, pp. 279-288, 2016

Multiplex PI-Control for Consensus in Networks of Heterogeneous Linear Agents

Authors: Daniel Alberto Burbano Lombana, Mario di Bernardo

Abstract: In this paper, we propose a multiplex proportional-integral approach, for solving consensus problems in networks of heterogeneous nodes dynamics affected by constant disturbances. The proportional and integral actions are deployed on two different layers across the network, each with its own topology. Sufficient conditions for convergence are derived that depend upon the structure of the network,… ▽ More In this paper, we propose a multiplex proportional-integral approach, for solving consensus problems in networks of heterogeneous nodes dynamics affected by constant disturbances. The proportional and integral actions are deployed on two different layers across the network, each with its own topology. Sufficient conditions for convergence are derived that depend upon the structure of the network, the parameters characterizing the control layers and the node dynamics. The effectiveness of the theoretical results is illustrated using a power network model as a representative example. △ Less

Submitted 9 December, 2015; v1 submitted 2 June, 2015; originally announced June 2015.

Comments: 13 pages, 6 Figures, Preprint submitted to Automatica

Self-organization of weighted networks for optimal synchronizability

Authors: Louis Kempton, Guido Herrmann, Mario di Bernardo

Abstract: We show that a network can self-organize its structure in a completely distributed manner in order to optimize its synchronizability whilst satisfying the local constraints: non-negativity of edge weights, and maximum weighted degree of nodes. A novel multilayer approach is presented which uses a distributed strategy to estimate two spectral functions of the graph Laplacian, the algebraic connecti… ▽ More We show that a network can self-organize its structure in a completely distributed manner in order to optimize its synchronizability whilst satisfying the local constraints: non-negativity of edge weights, and maximum weighted degree of nodes. A novel multilayer approach is presented which uses a distributed strategy to estimate two spectral functions of the graph Laplacian, the algebraic connectivity $λ_2$ and the eigenratio $r = λ_n / λ_2$ . These local estimates are then used to evolve the edge weights so as to maximize $λ_2$, or minimize $r$ and, hence, achieve an optimal structure. △ Less

Submitted 27 May, 2015; originally announced May 2015.