Showing 1–40 of 40 results for author: Hendrickx, J M

Exploiting Agent Symmetries for Performance Analysis of Distributed Optimization Methods

Authors: Sebastien Colla, Julien M. Hendrickx

Abstract: We show that, in many settings, the worst-case performance of a distributed optimization algorithm is independent of the number of agents in the system, and can thus be computed in the fundamental case with just two agents. This result relies on a novel approach that systematically exploits symmetries in worst-case performance computation, framed as Semidefinite Programming (SDP) via the Performan… ▽ More We show that, in many settings, the worst-case performance of a distributed optimization algorithm is independent of the number of agents in the system, and can thus be computed in the fundamental case with just two agents. This result relies on a novel approach that systematically exploits symmetries in worst-case performance computation, framed as Semidefinite Programming (SDP) via the Performance Estimation Problem (PEP) framework. Harnessing agent symmetries in the PEP yields compact problems whose size is independent of the number of agents in the system. When all agents are equivalent in the problem, we establish the explicit conditions under which the resulting worst-case performance is independent of the number of agents and is therefore equivalent to the basic case with two agents. Our compact PEP formulation also allows the consideration of multiple equivalence classes of agents, and its size only depends on the number of equivalence classes. This enables practical and automated performance analysis of distributed algorithms in numerous complex and realistic settings, such as the analysis of the worst agent performance. We leverage this new tool to analyze the performance of the EXTRA algorithm in advanced settings and its scalability with the number of agents, providing a tighter analysis and deeper understanding of the algorithm performance. △ Less

Submitted 18 March, 2024; originally announced March 2024.

Comments: submitted to Open Journal of Mathematical Optimization (OJMO)

On the Optimal Communication Weights in Distributed Optimization Algorithms

Authors: Sebastien Colla, Julien M. Hendrickx

Abstract: We establish that in distributed optimization, the prevalent strategy of minimizing the second-largest eigenvalue modulus (SLEM) of the averaging matrix for selecting communication weights, while optimal for existing theoretical performance bounds, is generally not optimal regarding the exact worst-case performance of the algorithms. This exact performance can be computed using the Performance Est… ▽ More We establish that in distributed optimization, the prevalent strategy of minimizing the second-largest eigenvalue modulus (SLEM) of the averaging matrix for selecting communication weights, while optimal for existing theoretical performance bounds, is generally not optimal regarding the exact worst-case performance of the algorithms. This exact performance can be computed using the Performance Estimation Problem (PEP) approach. We thus rely on PEP to formulate an optimization problem that determines the optimal communication weights for a distributed optimization algorithm deployed on a specified undirected graph. Our results show that the optimal weights can outperform the weights minimizing the second-largest eigenvalue modulus (SLEM) of the averaging matrix. This suggests that the SLEM is not the best characterization of weighted network performance for decentralized optimization. Additionally, we explore and compare alternative heuristics for weight selection in distributed optimization. △ Less

Submitted 8 February, 2024; originally announced February 2024.

Comments: 7 pages. Submitted to MTNS

Automated Performance Estimation for Decentralized Optimization via Network Size Independent Problems

Authors: Sebastien Colla, Julien M. Hendrickx

Abstract: We develop a novel formulation of the Performance Estimation Problem (PEP) for decentralized optimization whose size is independent of the number of agents in the network. The PEP approach allows computing automatically the worst-case performance and worst-case instance of first-order optimization methods by solving an SDP. Unlike previous work, the size of our new PEP formulation is independent o… ▽ More We develop a novel formulation of the Performance Estimation Problem (PEP) for decentralized optimization whose size is independent of the number of agents in the network. The PEP approach allows computing automatically the worst-case performance and worst-case instance of first-order optimization methods by solving an SDP. Unlike previous work, the size of our new PEP formulation is independent of the network size. For this purpose, we take a global view of the decentralized problem and we also decouple the consensus subspace and its orthogonal complement. We apply our methodology to different decentralized methods such as DGD, DIGing and EXTRA and obtain numerically tight performance guarantees that are valid for any network size. △ Less

Submitted 2 October, 2022; originally announced October 2022.

Comments: 8 pages, 3 figures, accepted for Conference on Decision and Control 2022. arXiv admin note: text overlap with arXiv:2203.05963

Resource allocation in open multi-agent systems: an online optimization analysis

Authors: Renato Vizuete, Charles Monnoyer de Galland, Julien M. Hendrickx, Paolo Frasca, Elena Panteley

Abstract: The resource allocation problem consists of the optimal distribution of a budget between agents in a group. We consider such a problem in the context of open systems, where agents can be replaced at some time instances. These replacements lead to variations in both the budget and the total cost function that hinder the overall network's performance. For a simple setting, we analyze the performance… ▽ More The resource allocation problem consists of the optimal distribution of a budget between agents in a group. We consider such a problem in the context of open systems, where agents can be replaced at some time instances. These replacements lead to variations in both the budget and the total cost function that hinder the overall network's performance. For a simple setting, we analyze the performance of the Random Coordinate Descent algorithm (RCD) using tools similar to those commonly used in online optimization. In particular, we study the accumulated errors that compare solutions issued from the RCD algorithm and the optimal solution or the non-collaborating selfish strategy and we derive some bounds in expectation for these accumulated errors. △ Less

Submitted 19 July, 2022; originally announced July 2022.

Comments: 7 pages, 3 figures, accepted for the 61st Conference on Decision and Control (CDC2022)

Random Coordinate Descent for Resource Allocation in Open Multi-Agent Systems

Authors: Charles Monnoyer de Galland, Renato Vizuete, Julien M. Hendrickx, Elena Panteley, Paolo Frasca

Abstract: We propose a method for analyzing the distributed random coordinate descent algorithm for solving separable resource allocation problems in the context of an open multiagent system, where agents can be replaced during the process. In particular, we characterize the evolution of the distance to the minimizer in expectation by following a time-varying optimization approach which builds on two compon… ▽ More We propose a method for analyzing the distributed random coordinate descent algorithm for solving separable resource allocation problems in the context of an open multiagent system, where agents can be replaced during the process. In particular, we characterize the evolution of the distance to the minimizer in expectation by following a time-varying optimization approach which builds on two components. First, we establish the linear convergence of the algorithm in closed systems, in terms of the estimate towards the minimizer, for general graphs and appropriate step-size. Second, we estimate the change of the optimal solution after a replacement, in order to evaluate its effect on the distance between the current estimate and the minimizer. From these two elements, we derive stability conditions in open systems and establish the linear convergence of the algorithm towards a steady-state expected error. Our results enable to characterize the trade-off between speed of convergence and robustness to agent replacements, under the assumptions that local functions are smooth, strongly convex, and have their minimizers located in a given ball. The approach proposed in this paper can moreover be extended to other algorithms guaranteeing linear convergence in closed system. △ Less

Submitted 20 September, 2023; v1 submitted 20 May, 2022; originally announced May 2022.

Comments: 14 pages, 9 figures, submitted to IEEE Transactions on Automatic Control

Automatic Performance Estimation for Decentralized Optimization

Authors: Sebastien Colla, Julien M. Hendrickx

Abstract: We present a methodology to automatically compute worst-case performance bounds for a large class of first-order decentralized optimization algorithms. These algorithms aim at minimizing the average of local functions that are distributed across a network of agents. They typically combine local computations and consensus steps. Our methodology is based on the approach of Performance Estimation Pro… ▽ More We present a methodology to automatically compute worst-case performance bounds for a large class of first-order decentralized optimization algorithms. These algorithms aim at minimizing the average of local functions that are distributed across a network of agents. They typically combine local computations and consensus steps. Our methodology is based on the approach of Performance Estimation Problem (PEP), which allows computing the worst-case performance and a worst-case instance of first-order optimization algorithms by solving an SDP. We propose two ways of representing consensus steps in PEPs, which allow writing and solving PEPs for decentralized optimization. The first formulation is exact but specific to a given averaging matrix. The second formulation is a relaxation but provides guarantees valid over an entire class of averaging matrices, characterized by their spectral range. This formulation often allows recovering a posteriori the worst possible averaging matrix for the given algorithm. We apply our methodology to three different decentralized methods. For each of them, we obtain numerically tight worst-case performance bounds that significantly improve on the existing ones, as well as insights about the parameters tuning and the worst communication networks. △ Less

Submitted 2 March, 2023; v1 submitted 11 March, 2022; originally announced March 2022.

Comments: 15 pages, 7 figures, accepted for publication in IEEE Transactions on Automatic Control. arXiv admin note: text overlap with arXiv:2103.14396

Random coordinate descent algorithm for open multi-agent systems with complete topology and homogeneous agents

Authors: Charles Monnoyer de Galland, Renato Vizuete, Julien M. Hendrickx, Paolo Frasca, Elena Panteley

Abstract: We study the convergence in expectation of the Random Coordinate Descent algorithm (RCD) for solving optimal resource allocations problems in open multi-agent systems, i.e., multi-agent systems that are subject to arrivals and departures of agents. Assuming all local functions are strongly-convex and smooth, and their minimizers lie in a given ball, we analyse the evolution of the distance to the… ▽ More We study the convergence in expectation of the Random Coordinate Descent algorithm (RCD) for solving optimal resource allocations problems in open multi-agent systems, i.e., multi-agent systems that are subject to arrivals and departures of agents. Assuming all local functions are strongly-convex and smooth, and their minimizers lie in a given ball, we analyse the evolution of the distance to the minimizer in expectation when the system is occasionally subject to replacements in addition to the usual iterations of the RCD algorithm. We focus on complete graphs where all agents interact with each other with the same probability, and provide conditions to guarantee convergence in open system. Finally, a discussion around the tightness of our results is provided. △ Less

Submitted 29 September, 2021; originally announced September 2021.

Comments: 8 pages, 3 figures, to be published in proceedings of the 60th IEEE Conference on Decision and Control (CDC2021)

2-D Directed Formation Control Based on Bipolar Coordinates

Authors: Farhad Mehdifar, Charalampos P. Bechlioulis, Julien M. Hendrickx, Dimos V. Dimarogonas

Abstract: This work proposes a novel 2-D formation control scheme for acyclic triangulated directed graphs (a class of minimally acyclic persistent graphs) based on bipolar coordinates with (almost) global convergence to the desired shape. Prescribed performance control is employed to devise a decentralized control law that avoids singularities and introduces robustness against external disturbances while e… ▽ More This work proposes a novel 2-D formation control scheme for acyclic triangulated directed graphs (a class of minimally acyclic persistent graphs) based on bipolar coordinates with (almost) global convergence to the desired shape. Prescribed performance control is employed to devise a decentralized control law that avoids singularities and introduces robustness against external disturbances while ensuring predefined transient and steady-state performance for the closed-loop system. Furthermore, it is shown that the proposed formation control scheme can handle formation maneuvering, scaling, and orientation specifications simultaneously. Additionally, the proposed control law is implementable in agents' arbitrarily oriented local coordinate frames using only low-cost onboard vision sensors, which are favorable for practical applications. Finally, a formation maneuvering simulation study verifies the proposed approach. △ Less

Submitted 12 September, 2022; v1 submitted 2 August, 2021; originally announced August 2021.

Comments: Submitted to IEEE TAC

Automated Worst-Case Performance Analysis of Decentralized Gradient Descent

Authors: Sebastien Colla, Julien M. Hendrickx

Abstract: We develop a methodology to automatically compute worst-case performance bounds for a class of decentralized algorithms that optimize the average of local functions distributed across a network. We extend the recently proposed PEP approach to decentralized optimization. This approach allows computing the exact worst-case performance and worst-case instance of centralized algorithms by solving an S… ▽ More We develop a methodology to automatically compute worst-case performance bounds for a class of decentralized algorithms that optimize the average of local functions distributed across a network. We extend the recently proposed PEP approach to decentralized optimization. This approach allows computing the exact worst-case performance and worst-case instance of centralized algorithms by solving an SDP. We obtain an exact formulation when the network matrix is given, and a relaxation when considering entire classes of network matrices characterized by their spectral range. We apply our methodology to the decentralized (sub)gradient method, obtain a nearly tight worst-case performance bound that significantly improves over the literature, and gain insights into the worst communication networks for a given spectral range. △ Less

Submitted 1 October, 2021; v1 submitted 26 March, 2021; originally announced March 2021.

Comments: 7 pages, 4 figures, accepted at the Conference on Decision and Control 2021

Are energy savings the only reason for the emergence of bird echelon formation?

Authors: Mingming Shi, Julien M. Hendrickx

Abstract: We analyze the conditions under which the emergence of frequently observed echelon formation can be explained solely by the maximization of energy savings. We consider a two-dimensional multi-agent echelon formation, where each agent receives a benefit that depends on its position relative to the others, and adjusts its position to increase this benefit. We analyze the selfish case where each agen… ▽ More We analyze the conditions under which the emergence of frequently observed echelon formation can be explained solely by the maximization of energy savings. We consider a two-dimensional multi-agent echelon formation, where each agent receives a benefit that depends on its position relative to the others, and adjusts its position to increase this benefit. We analyze the selfish case where each agent maximizes its own benefit, leading to a Nash-equilibrium problem, and the collaborative case in which agents maximize the global benefit of the group. We provide conditions on the benefit function under which the frequently observed echelon formations cannot be Nash equilbriums or group optimums. We then show that these conditions are satisfied by the conventionally used fixed-wing wake benefit model. This implies that energy saving alone is not sufficient to explain the emergence of the migratory formations observed, based on the fixed-wing model. Hence, either non-aerodynamic aspects or a more accurate model of bird dynamics should be considered to construct such formations. △ Less

Submitted 24 March, 2021; originally announced March 2021.

Comments: 8 pages, 12 figures, submitted to a conference

Stability of Decentralized Gradient Descent in Open Multi-Agent Systems

Authors: Julien M. Hendrickx, Michael G. Rabbat

Abstract: The aim of decentralized gradient descent (DGD) is to minimize a sum of $n$ functions held by interconnected agents. We study the stability of DGD in open contexts where agents can join or leave the system, resulting each time in the addition or the removal of their function from the global objective. Assuming all functions are smooth, strongly convex, and their minimizers all lie in a given ball,… ▽ More The aim of decentralized gradient descent (DGD) is to minimize a sum of $n$ functions held by interconnected agents. We study the stability of DGD in open contexts where agents can join or leave the system, resulting each time in the addition or the removal of their function from the global objective. Assuming all functions are smooth, strongly convex, and their minimizers all lie in a given ball, we characterize the sensitivity of the global minimizer of the sum of these functions to the removal or addition of a new function and provide bounds in $ O\left(\min \left(κ^{0.5}, κ/n^{0.5},κ^{1.5}/n\right)\right)$ where $κ$ is the condition number. We also show that the states of all agents can be eventually bounded independently of the sequence of arrivals and departures. The magnitude of the bound scales with the importance of the interconnection, which also determines the accuracy of the final solution in the absence of arrival and departure, exposing thus a potential trade-off between accuracy and sensitivity. Our analysis relies on the formulation of DGD as gradient descent on an auxiliary function. The tightness of our results is analyzed using the PESTO Toolbox. △ Less

Submitted 11 September, 2020; originally announced September 2020.

Comments: 8 pages, 2 figures, 3 pdf files for the figures

Modelling Gossip Interactions in Open Multi-Agent Systems

Authors: Charles Monnoyer de Galland, Samuel Martin, Julien M. Hendrickx

Abstract: We consider open multi-agent systems, which are systems subject to frequent arrivals and departures of agents while the studied process takes place. We study the behavior of all-to-all pairwise gossip interactions in such open systems. Arrivals and departures of agents imply that the composition and size of the system evolve with time, and in particular prevent convergence. We describe the expecte… ▽ More We consider open multi-agent systems, which are systems subject to frequent arrivals and departures of agents while the studied process takes place. We study the behavior of all-to-all pairwise gossip interactions in such open systems. Arrivals and departures of agents imply that the composition and size of the system evolve with time, and in particular prevent convergence. We describe the expected behavior of the system by showing that the evolution of scale-independent quantities can be characterized exactly by a fixed-size linear dynamical system. We apply this approach to characterize the evolution of the two first moments (and thus also of the variance) for open systems of fixed and variable size. Our approach is based on the continuous-time modelling of random asynchronous events impacting the systems (gossip steps, arrivals, departures, and replacements), and can be extended to other types of events. △ Less

Submitted 16 March, 2022; v1 submitted 7 September, 2020; originally announced September 2020.

Comments: 8 pages, 4 figures, submitted to IEEE Transactions on Automatic Control (ITAC)

Fundamental Performance Limitations for Average Consensus in Open Multi-Agent Systems

Authors: Charles Monnoyer de Galland, Julien M. Hendrickx

Abstract: We derive fundamental performance limitations for intrinsic average consensus problems in open multi-agent systems, which are systems subject to frequent arrivals and departures of agents. Each agent holds a value, and the objective of the agents is to collaboratively estimate the average of the values of the agents presently in the system. Algorithms solving such problems in open systems are pois… ▽ More We derive fundamental performance limitations for intrinsic average consensus problems in open multi-agent systems, which are systems subject to frequent arrivals and departures of agents. Each agent holds a value, and the objective of the agents is to collaboratively estimate the average of the values of the agents presently in the system. Algorithms solving such problems in open systems are poised to never converge because of the permanent variations in the composition, size and objective pursued by the agents of the system. We provide lower bounds on the expected Mean Squared Error achievable by any averaging algorithms in open systems of fixed size. Our derivation is based on the analysis of a conceptual algorithm that would achieve optimal performance for a given model of replacements. We obtain a general bound that depends on the properties of the model defining the interactions between the agents, and instantiate that result for all-to-one and one-to-one interaction models. A comparison between those bounds and algorithms implementable with those models is then provided to highlight their validity. △ Less

Submitted 11 January, 2022; v1 submitted 14 April, 2020; originally announced April 2020.

Comments: 13 pages, 9 figures, accepted for publication in IEEE Transactions on Automatic Control

Lower bound performances for average consensus in open multi-agent systems (extended version)

Authors: Charles Monnoyer de Galland, Julien M. Hendrickx

Abstract: We derive fundamental limitations on the performances of intrinsic averaging algorithms in open multi-agent systems, which are systems subject to random arrivals and departures of agents. Each agent holds a value, and their goal is to estimate the average of the values of the agents presently in the system. We provide a lower bound on the expected Mean Square Error for any estimation algorithm, as… ▽ More We derive fundamental limitations on the performances of intrinsic averaging algorithms in open multi-agent systems, which are systems subject to random arrivals and departures of agents. Each agent holds a value, and their goal is to estimate the average of the values of the agents presently in the system. We provide a lower bound on the expected Mean Square Error for any estimation algorithm, assuming that the number of agents remains constant and that communications are random and pairwise. Our derivation is based on the expected error obtained with an optimal algorithm under conditions more favorable than those the actual problem allows, and relies on an analysis of the constraints on the information spreading mechanisms in the system, and relaxations of these. △ Less

Submitted 11 September, 2019; v1 submitted 5 September, 2019; originally announced September 2019.

Comments: 7 pages, 3 figures, submitted to Conference on Decision and Control 2019

Trajectory convergence from coordinate-wise decrease of quadratic energy functions, and applications to platoons

Authors: Julien M. Hendrickx, Balazs Gerencser, Baris Fidan

Abstract: We consider trajectories where the sign of the derivative of each entry is opposite to that of the corresponding entry in the gradient of an energy function. We show that this condition guarantees convergence when the energy function is quadratic and positive definite and partly extend that result to some classes of positive semi-definite quadratic functions including those defined using a graph L… ▽ More We consider trajectories where the sign of the derivative of each entry is opposite to that of the corresponding entry in the gradient of an energy function. We show that this condition guarantees convergence when the energy function is quadratic and positive definite and partly extend that result to some classes of positive semi-definite quadratic functions including those defined using a graph Laplacian. We show how this condition allows establishing the convergence of a platoon application in which it naturally appears, due to deadzones in the control laws designed to avoid instabilities caused by inconsistent measurements of the same distance by different agents. △ Less

Submitted 10 June, 2019; v1 submitted 1 March, 2019; originally announced March 2019.

Comments: 6 pages, 2 figures, double columns

Graph Resistance and Learning from Pairwise Comparisons

Authors: Julien M. Hendrickx, Alex Olshevsky, Venkatesh Saligrama

Abstract: We consider the problem of learning the qualities of a collection of items by performing noisy comparisons among them. Following the standard paradigm, we assume there is a fixed "comparison graph" and every neighboring pair of items in this graph is compared $k$ times according to the Bradley-Terry-Luce model (where the probability than an item wins a comparison is proportional the item quality).… ▽ More We consider the problem of learning the qualities of a collection of items by performing noisy comparisons among them. Following the standard paradigm, we assume there is a fixed "comparison graph" and every neighboring pair of items in this graph is compared $k$ times according to the Bradley-Terry-Luce model (where the probability than an item wins a comparison is proportional the item quality). We are interested in how the relative error in quality estimation scales with the comparison graph in the regime where $k$ is large. We prove that, after a known transition period, the relevant graph-theoretic quantity is the square root of the resistance of the comparison graph. Specifically, we provide an algorithm that is minimax optimal. The algorithm has a relative error decay that scales with the square root of the graph resistance, and provide a matching lower bound (up to log factors). The performance guarantee of our algorithm, both in terms of the graph and the skewness of the item quality distribution, outperforms earlier results. △ Less

Submitted 12 June, 2019; v1 submitted 31 January, 2019; originally announced February 2019.

Comments: 15 pages, including 5 pages supplementary material

Sets of Stochastic Matrices with Converging Products: Bounds and Complexity

Authors: Pierre-Yves Chevalier, Vladimir V. Gusev, Raphaël M. Jungers, Julien M. Hendrickx

Abstract: An SIA matrix is a stochastic matrix whose sequence of powers converges to a rank-one matrix. This convergence is desirable in various applications making use of stochastic matrices, such as consensus, distributed optimization and Markov chains. We study the shortest SIA products of sets of matrices. We observe that the shortest SIA product of a set of matrices is usually very short and we provide… ▽ More An SIA matrix is a stochastic matrix whose sequence of powers converges to a rank-one matrix. This convergence is desirable in various applications making use of stochastic matrices, such as consensus, distributed optimization and Markov chains. We study the shortest SIA products of sets of matrices. We observe that the shortest SIA product of a set of matrices is usually very short and we provide a first upper bound on the length of the shortest SIA product (if one exists) of any set of stochastic matrices. We also provide an algorithm that decides the existence of an SIA product. When particularized to automata, the problem becomes that of finding periodic synchronizing words, and we develop the consequences of our results in relation with the celebrated Cerny conjecture in automata theory. We also investigate links with the related notions of positive-column, Sarymsakov, and scrambling matrices. △ Less

Submitted 7 December, 2017; originally announced December 2017.

MSC Class: 15B51; 15B35; 60J10

MAX-consensus in open multi-agent systems with gossip interactions

Authors: Mahmoud Abdelrahim, Julien M. Hendrickx, W. P. M. H. Heemels

Abstract: We study the problem of distributed maximum computation in an open multi-agent system, where agents can leave and arrive during the execution of the algorithm. The main challenge comes from the possibility that the agent holding the largest value leaves the system, which changes the value to be computed. The algorithms must as a result be endowed with mechanisms allowing to forget outdated informa… ▽ More We study the problem of distributed maximum computation in an open multi-agent system, where agents can leave and arrive during the execution of the algorithm. The main challenge comes from the possibility that the agent holding the largest value leaves the system, which changes the value to be computed. The algorithms must as a result be endowed with mechanisms allowing to forget outdated information. The focus is on systems in which interactions are pairwise gossips between randomly selected agents. We consider situations where leaving agents can send a last message, and situations where they cannot. For both cases, we provide algorithms able to eventually compute the maximum of the values held by agents. △ Less

Submitted 18 September, 2017; originally announced September 2017.

Comments: To appear in the proceedings of the 56th IEEE Conference on Decision and Control (CDC 17). 8 pages, 3 figures

Open Multi-Agent Systems: Gossi** with Random Arrivals and Departures

Authors: Julien M. Hendrickx, Samuel Martin

Abstract: We consider open multi-agent systems. Unlike the systems usually studied in the literature, here agents may join or leave while the process studied takes place. The system composition and size evolve thus with time. We focus here on systems where the interactions between agents lead to pairwise gossip averages, and where agents either arrive or are replaced at random times. These events prevent an… ▽ More We consider open multi-agent systems. Unlike the systems usually studied in the literature, here agents may join or leave while the process studied takes place. The system composition and size evolve thus with time. We focus here on systems where the interactions between agents lead to pairwise gossip averages, and where agents either arrive or are replaced at random times. These events prevent any convergence of the system. Instead, we describe the expected system behavior by showing that the evolution of scaled moments of the state can be characterized by a 2-dimensional (possibly time-varying) linear dynamical system. We apply this technique to two cases : (i) systems with fixed size where leaving agents are immediately replaced, and (ii) systems where new agents keep arriving without ever leaving, and whose size grows thus unbounded. △ Less

Submitted 15 September, 2017; originally announced September 2017.

Comments: Extended version of a paper Accepted at the 56th IEEE Conference on Decision and Control (CDC 17), Melbourne, Australia 8 pages, 5 pdf figures

Incompatibility boundaries for properties of community partitions

Authors: Arnaud Browet, Julien M. Hendrickx, Alain Sarlette

Abstract: We prove the incompatibility of certain desirable properties of community partition quality functions. Our results generalize the impossibility result of [Kleinberg 2003] by considering sets of weaker properties. In particular, we use an alternative notion to solve the central issue of the consistency property. (The latter means that modifying the graph in a way consistent with a partition should… ▽ More We prove the incompatibility of certain desirable properties of community partition quality functions. Our results generalize the impossibility result of [Kleinberg 2003] by considering sets of weaker properties. In particular, we use an alternative notion to solve the central issue of the consistency property. (The latter means that modifying the graph in a way consistent with a partition should not have counterintuitive effects). Our results clearly show that community partition methods should not be expected to perfectly satisfy all ideally desired properties. We then proceed to show that this incompatibility no longer holds when slightly relaxed versions of the properties are considered, and we provide in fact examples of simple quality functions satisfying these relaxed properties. An experimental study of these quality functions shows a behavior comparable to established methods in some situations, but more debatable results in others. This suggests that defining a notion of good partition in communities probably requires imposing additional properties. △ Less

Submitted 2 March, 2016; originally announced March 2016.

Comments: 17 pages, 3 figures

Tight Bounds for Consensus Systems Convergence

Authors: Pierre-Yves Chevalier, Julien M. Hendrickx, Raphaël M. Jungers

Abstract: We analyze the asymptotic convergence of all infinite products of matrices taken in a given finite set, by looking only at finite or periodic products. It is known that when the matrices of the set have a common nonincreasing polyhedral norm, all infinite products converge to zero if and only if all infinite periodic products with period smaller than a certain value converge to zero, and bounds ex… ▽ More We analyze the asymptotic convergence of all infinite products of matrices taken in a given finite set, by looking only at finite or periodic products. It is known that when the matrices of the set have a common nonincreasing polyhedral norm, all infinite products converge to zero if and only if all infinite periodic products with period smaller than a certain value converge to zero, and bounds exist on that value. We provide a stronger bound holding for both polyhedral norms and polyhedral seminorms. In the latter case, the matrix products do not necessarily converge to 0, but all trajectories of the associated system converge to a common invariant space. We prove our bound to be tight, in the sense that for any polyhedral seminorm, there is a set of matrices such that not all infinite products converge, but every periodic product with period smaller than our bound does converge. Our technique is based on an analysis of the combinatorial structure of the face lattice of the unit ball of the nonincreasing seminorm. The bound we obtain is equal to half the size of the largest antichain in this lattice. Explicitly evaluating this quantity may be challenging in some cases. We therefore link our problem with the Sperner property: the property that, for some graded posets, -- in this case the face lattice of the unit ball -- the size of the largest antichain is equal to the size of the largest rank level. We show that some sets of matrices with invariant polyhedral seminorms lead to posets that do not have that Sperner property. However, this property holds for the polyhedron obtained when treating sets of stochastic matrices, and our bound can then be easily evaluated in that case. In particular, we show that for the dimension of the space $n \geq 8$, our bound is smaller than the previously known bound by a multiplicative factor of $\frac{3}{2 \sqrt{πn}}$. △ Less

Submitted 13 October, 2016; v1 submitted 19 January, 2016; originally announced January 2016.

Modelling influence and opinion evolution in online collective behaviour

Authors: Corentin Vande Kerckhove, Samuel Martin, Pascal Gend, Peter J. Rentfrow, Julien M. Hendrickx, Vincent D. Blondel

Abstract: Opinion evolution and judgment revision are mediated through social influence. Based on a large crowdsourced in vitro experiment (n=861), it is shown how a consensus model can be used to predict opinion evolution in online collective behaviour. It is the first time the predictive power of a quantitative model of opinion dynamics is tested against a real dataset. Unlike previous research on the top… ▽ More Opinion evolution and judgment revision are mediated through social influence. Based on a large crowdsourced in vitro experiment (n=861), it is shown how a consensus model can be used to predict opinion evolution in online collective behaviour. It is the first time the predictive power of a quantitative model of opinion dynamics is tested against a real dataset. Unlike previous research on the topic, the model was validated on data which did not serve to calibrate it. This avoids to favor more complex models over more simple ones and prevents overfitting. The model is parametrized by the influenceability of each individual, a factor representing to what extent individuals incorporate external judgments. The prediction accuracy depends on prior knowledge on the participants' past behaviour. Several situations reflecting data availability are compared. When the data is scarce, the data from previous participants is used to predict how a new participant will behave. Judgment revision includes unpredictable variations which limit the potential for prediction. A first measure of unpredictability is proposed. The measure is based on a specific control experiment. More than two thirds of the prediction errors are found to occur due to unpredictability of the human judgment revision process rather than to model imperfection. △ Less

Submitted 3 June, 2016; v1 submitted 9 November, 2015; originally announced November 2015.

Comments: Accepted for publication in PLOS ONE (2016)

Markov modeling of online inter-arrival times

Authors: Corentin Vande Kerckhove, Balázs Gerencsér, Julien M. Hendrickx, Vincent D. Blondel

Abstract: In this paper, we investigate the arising communication patterns on social media, and in particular the series of events happening for a single user. While the distribution of inter-event times is often assimilated to power-law density functions, a debate persists on the nature of an underlying model that explains the observed distribution. In the present, we propose an intuitive explanation to un… ▽ More In this paper, we investigate the arising communication patterns on social media, and in particular the series of events happening for a single user. While the distribution of inter-event times is often assimilated to power-law density functions, a debate persists on the nature of an underlying model that explains the observed distribution. In the present, we propose an intuitive explanation to understand the observed dependence of subsequent waiting times. Our contribution is twofold. The first idea consists of separating the short waiting times -- out of scope for power-law distributions -- from the long ones. The model is further enhanced by introducing a two-state Markovian process to incorporate memory. △ Less

Submitted 7 December, 2018; v1 submitted 16 September, 2015; originally announced September 2015.

MSC Class: 62P25 (Primary); 91C20(Secondary)

Distributed Event-Triggered Control for Asymptotic Synchronization of Dynamical Networks

Authors: Tao Liu, Ming Cao, Claudio De Persis, Julien M. Hendrickx

Abstract: This paper studies synchronization of dynamical networks with event-based communication. Firstly, two estimators are introduced into each node, one to estimate its own state, and the other to estimate the average state of its neighbours. Then, with these two estimators, a distributed event-triggering rule (ETR) with a dwell time is designed such that the network achieves synchronization asymptotic… ▽ More This paper studies synchronization of dynamical networks with event-based communication. Firstly, two estimators are introduced into each node, one to estimate its own state, and the other to estimate the average state of its neighbours. Then, with these two estimators, a distributed event-triggering rule (ETR) with a dwell time is designed such that the network achieves synchronization asymptotically with no Zeno behaviours. The designed ETR only depends on the information that each node can obtain, and thus can be implemented in a decentralized way. △ Less

Submitted 6 January, 2018; v1 submitted 19 August, 2015; originally announced August 2015.

Comments: 8 pages, 2 figues, 1 table

Reachability of Consensus and Synchronizing Automata

Authors: Pierre-Yves Chevalier, Julien M. Hendrickx, Raphaël M. Jungers

Abstract: We consider the problem of determining the existence of a sequence of matrices driving a discrete-time consensus system to consensus. We transform this problem into one of the existence of a product of the transition (stochastic) matrices that has a positive column. We then generalize some results from automata theory to sets of stochastic matrices. We obtain as a main result a polynomial-time alg… ▽ More We consider the problem of determining the existence of a sequence of matrices driving a discrete-time consensus system to consensus. We transform this problem into one of the existence of a product of the transition (stochastic) matrices that has a positive column. We then generalize some results from automata theory to sets of stochastic matrices. We obtain as a main result a polynomial-time algorithm to decide the existence of a sequence of matrices achieving consensus. △ Less

Submitted 2 October, 2015; v1 submitted 1 May, 2015; originally announced May 2015.

Comments: Update after review

Push sum with transmission failures

Authors: Balázs Gerencsér, Julien M. Hendrickx

Abstract: The push-sum algorithm allows distributed computing of the average on a directed graph, and is particularly relevant when one is restricted to one-way and/or asynchronous communications. We investigate its behavior in the presence of unreliable communication channels where messages can be lost. We show that exponential convergence still holds and deduce fundamental properties that implicitly descr… ▽ More The push-sum algorithm allows distributed computing of the average on a directed graph, and is particularly relevant when one is restricted to one-way and/or asynchronous communications. We investigate its behavior in the presence of unreliable communication channels where messages can be lost. We show that exponential convergence still holds and deduce fundamental properties that implicitly describe the distribution of the final value obtained. We analyze the error of the final common value we get for the essential case of two nodes, both theoretically and numerically. We provide performance comparison with a standard consensus algorithm. △ Less

Submitted 31 May, 2017; v1 submitted 30 April, 2015; originally announced April 2015.

MSC Class: 90B18; 68M10; 68W15; 93A14

Efficient Algorithms for the Consensus Decision Problem

Authors: Pierre-Yves Chevalier, Julien M. Hendrickx, Raphaël M. Jungers

Abstract: We address the problem of determining if a discrete time switched consensus system converges for any switching sequence and that of determining if it converges for at least one switching sequence. For these two problems, we provide necessary and sufficient conditions that can be checked in singly exponential time. As a side result, we prove the existence of a polynomial time algorithm for the firs… ▽ More We address the problem of determining if a discrete time switched consensus system converges for any switching sequence and that of determining if it converges for at least one switching sequence. For these two problems, we provide necessary and sufficient conditions that can be checked in singly exponential time. As a side result, we prove the existence of a polynomial time algorithm for the first problem when the system switches between only two subsystems whose corresponding graphs are undirected, a problem that had been suggested to be NP-hard by Blondel and Olshevsky. △ Less

Submitted 21 May, 2015; v1 submitted 23 September, 2014; originally announced September 2014.

Comments: Small modifications after comments from reviewers

Optimal one-dimensional coverage by unreliable sensors

Authors: Paolo Frasca, Federica Garin, Balazs Gerencser, Julien M. Hendrickx

Abstract: This paper regards the problem of optimally placing unreliable sensors in a one-dimensional environment. We assume that sensors can fail with a certain probability and we minimize the expected maximum distance from any point in the environment to the closest active sensor. We provide a computational method to find the optimal placement and we estimate the relative quality of equispaced and random… ▽ More This paper regards the problem of optimally placing unreliable sensors in a one-dimensional environment. We assume that sensors can fail with a certain probability and we minimize the expected maximum distance from any point in the environment to the closest active sensor. We provide a computational method to find the optimal placement and we estimate the relative quality of equispaced and random placements. We prove that the former is asymptotically equivalent to the optimal placement when the number of sensors goes to infinity, with a cost ratio converging to 1, while the cost of the latter remains strictly larger. △ Less

Submitted 14 November, 2014; v1 submitted 30 April, 2014; originally announced April 2014.

Comments: 21 pages 2 figures

MSC Class: 60K30; 90B18; 68M10; 49N99; 68R01

On symmetric continuum opinion dynamics

Authors: Julien M. Hendrickx, Alex Olshevsky

Abstract: This paper investigates the asymptotic behavior of some common opinion dynamic models in a continuum of agents. We show that as long as the interactions among the agents are symmetric, the distribution of the agents' opinion converges. We also investigate whether convergence occurs in a stronger sense than merely in distribution, namely, whether the opinion of almost every agent converges. We show… ▽ More This paper investigates the asymptotic behavior of some common opinion dynamic models in a continuum of agents. We show that as long as the interactions among the agents are symmetric, the distribution of the agents' opinion converges. We also investigate whether convergence occurs in a stronger sense than merely in distribution, namely, whether the opinion of almost every agent converges. We show that while this is not the case in general, it becomes true under plausible assumptions on inter-agent interactions, namely that agents with similar opinions exert a non-negligible pull on each other, or that the interactions are entirely determined by their opinions via a smooth function. △ Less

Submitted 10 August, 2016; v1 submitted 2 November, 2013; originally announced November 2013.

Comments: 28 pages, 2 figures, 3 files

MSC Class: 93D20; 91C20; 93A14

Finite-time consensus using stochastic matrices with positive diagonals

Authors: Julien M. Hendrickx, Guodong Shi, Karl H. Johansson

Abstract: We discuss the possibility of reaching consensus in finite time using only linear iterations, with the additional restrictions that the update matrices must be stochastic with positive diagonals and consistent with a given graph structure. We show that finite-time average consensus can always be achieved for connected undirected graphs. For directed graphs, we show some necessary conditions for fi… ▽ More We discuss the possibility of reaching consensus in finite time using only linear iterations, with the additional restrictions that the update matrices must be stochastic with positive diagonals and consistent with a given graph structure. We show that finite-time average consensus can always be achieved for connected undirected graphs. For directed graphs, we show some necessary conditions for finite-time consensus, including strong connectivity and the presence of a simple cycle of even length. △ Less

Submitted 25 August, 2014; v1 submitted 27 February, 2013; originally announced February 2013.

Comments: 5 pages, 3 figures

Graph diameter, eigenvalues, and minimum-time consensus

Authors: Julien M. Hendrickx, Raphaël M. Jungers, Alexander Olshevsky, Guillaume Vankeerberghen

Abstract: We consider the problem of achieving average consensus in the minimum number of linear iterations on a fixed, undirected graph. We are motivated by the task of deriving lower bounds for consensus protocols and by the so-called "definitive consensus conjecture" which states that for an undirected connected graph G with diameter D there exist D matrices whose nonzero-pattern complies with the edges… ▽ More We consider the problem of achieving average consensus in the minimum number of linear iterations on a fixed, undirected graph. We are motivated by the task of deriving lower bounds for consensus protocols and by the so-called "definitive consensus conjecture" which states that for an undirected connected graph G with diameter D there exist D matrices whose nonzero-pattern complies with the edges in G and whose product equals the all-ones matrix. Our first result is a counterexample to the definitive consensus conjecture, which is the first improvement of the diameter lower bound for linear consensus protocols. We then provide some algebraic conditions under which this conjecture holds, which we use to establish that all distance-regular graphs satisfy the definitive consensus conjecture. △ Less

Submitted 29 August, 2013; v1 submitted 27 November, 2012; originally announced November 2012.

On the mean square error of randomized averaging algorithms

Authors: Paolo Frasca, Julien M. Hendrickx

Abstract: This paper regards randomized discrete-time consensus systems that preserve the average "on average". As a main result, we provide an upper bound on the mean square deviation of the consensus value from the initial average. Then, we apply our result to systems where few or weakly correlated interactions take place: these assumptions cover several algorithms proposed in the literature. For such sys… ▽ More This paper regards randomized discrete-time consensus systems that preserve the average "on average". As a main result, we provide an upper bound on the mean square deviation of the consensus value from the initial average. Then, we apply our result to systems where few or weakly correlated interactions take place: these assumptions cover several algorithms proposed in the literature. For such systems we show that, when the network size grows, the deviation tends to zero, and the speed of this decay is not slower than the inverse of the size. Our results are based on a new approach, which is unrelated to the convergence properties of the system. △ Less

Submitted 18 April, 2013; v1 submitted 19 November, 2011; originally announced November 2011.

Comments: 11 pages. to appear as a journal publication

Convergence of type-symmetric and cut-balanced consensus seeking systems (extended version)

Authors: Julien M. Hendrickx, John N. Tsitsiklis

Abstract: We consider continuous-time consensus seeking systems whose time-dependent interactions are cut-balanced, in the following sense: if a group of agents influences the remaining ones, the former group is also influenced by the remaining ones by at least a proportional amount. Models involving symmetric interconnections and models in which a weighted average of the agent values is conserved are speci… ▽ More We consider continuous-time consensus seeking systems whose time-dependent interactions are cut-balanced, in the following sense: if a group of agents influences the remaining ones, the former group is also influenced by the remaining ones by at least a proportional amount. Models involving symmetric interconnections and models in which a weighted average of the agent values is conserved are special cases. We prove that such systems always converge. We give a sufficient condition on the evolving interaction topology for the limit values of two agents to be the same. Conversely, we show that if our condition is not satisfied, then these limits are generically different. These results allow treating systems where the agent interactions are a priori unknown, e.g., random or determined endogenously by the agent values. We also derive corresponding results for discrete-time systems. △ Less

Submitted 26 April, 2013; v1 submitted 11 February, 2011; originally announced February 2011.

Comments: update of the file following publication of journal version, including a minor correction in the proof of theorem 1(b). 12 pages, 12 tex files, no figure

Distributed anonymous discrete function computation

Authors: Julien M. Hendrickx, Alex Olshevsky, John N. Tsitsiklis

Abstract: We propose a model for deterministic distributed function computation by a network of identical and anonymous nodes. In this model, each node has bounded computation and storage capabilities that do not grow with the network size. Furthermore, each node only knows its neighbors, not the entire graph. Our goal is to characterize the class of functions that can be computed within this model. In our… ▽ More We propose a model for deterministic distributed function computation by a network of identical and anonymous nodes. In this model, each node has bounded computation and storage capabilities that do not grow with the network size. Furthermore, each node only knows its neighbors, not the entire graph. Our goal is to characterize the class of functions that can be computed within this model. In our main result, we provide a necessary condition for computability which we show to be nearly sufficient, in the sense that every function that satisfies this condition can at least be approximated. The problem of computing suitably rounded averages in a distributed manner plays a central role in our development; we provide an algorithm that solves it in time that grows quadratically with the size of the network. △ Less

Submitted 25 June, 2011; v1 submitted 12 April, 2010; originally announced April 2010.

Matrix P-norms are NP-hard to approximate if p \neq 1,2,\infty

Authors: Julien M. Hendrickx, Alex Olshevsky

Abstract: We show that for any rational p \in [1,\infty) except p = 1, 2, unless P = NP, there is no polynomial-time algorithm for approximating the matrix p-norm to arbitrary relative precision. We also show that for any rational p\in [1,\infty) including p = 1, 2, unless P = NP, there is no polynomial-time algorithm approximates the \infty, p mixed norm to some fixed relative precision. We show that for any rational p \in [1,\infty) except p = 1, 2, unless P = NP, there is no polynomial-time algorithm for approximating the matrix p-norm to arbitrary relative precision. We also show that for any rational p\in [1,\infty) including p = 1, 2, unless P = NP, there is no polynomial-time algorithm approximates the \infty, p mixed norm to some fixed relative precision. △ Less

Submitted 23 April, 2010; v1 submitted 10 August, 2009; originally announced August 2009.

Comments: 12 pages

Distributed anonymous function computation in information fusion and multiagent systems

Authors: Julien M. Hendrickx, Alex Olshevsky, John N. Tsitsiklis

Abstract: We propose a model for deterministic distributed function computation by a network of identical and anonymous nodes, with bounded computation and storage capabilities that do not scale with the network size. Our goal is to characterize the class of functions that can be computed within this model. In our main result, we exhibit a class of non-computable functions, and prove that every function o… ▽ More We propose a model for deterministic distributed function computation by a network of identical and anonymous nodes, with bounded computation and storage capabilities that do not scale with the network size. Our goal is to characterize the class of functions that can be computed within this model. In our main result, we exhibit a class of non-computable functions, and prove that every function outside this class can at least be approximated. The problem of computing averages in a distributed manner plays a central role in our development. △ Less

Submitted 28 July, 2009; v1 submitted 16 July, 2009; originally announced July 2009.

On Krause's multi-agent consensus model with state-dependent connectivity (Extended version)

Authors: Vincent D. Blondel, Julien M. Hendrickx, John N. Tsitsiklis

Abstract: We study a model of opinion dynamics introduced by Krause: each agent has an opinion represented by a real number, and updates its opinion by averaging all agent opinions that differ from its own by less than 1. We give a new proof of convergence into clusters of agents, with all agents in the same cluster holding the same opinion. We then introduce a particular notion of equilibrium stability a… ▽ More We study a model of opinion dynamics introduced by Krause: each agent has an opinion represented by a real number, and updates its opinion by averaging all agent opinions that differ from its own by less than 1. We give a new proof of convergence into clusters of agents, with all agents in the same cluster holding the same opinion. We then introduce a particular notion of equilibrium stability and provide lower bounds on the inter-cluster distances at a stable equilibrium. To better understand the behavior of the system when the number of agents is large, we also introduce and study a variant involving a continuum of agents, obtaining partial convergence results and lower bounds on inter-cluster distances, under some mild assumptions. △ Less

Submitted 12 March, 2009; v1 submitted 13 July, 2008; originally announced July 2008.

Comments: 11 tex files, 13 eps files, 1 style file, 15 double columns pages

Rigidity and persistence for ensuring shape maintenance of multiagent meta formations (ext'd version)

Authors: Julien M. Hendrickx, Changbin Yu, Baris Fidan, Brian D. O. Anderson

Abstract: This paper treats the problem of the merging of formations, where the underlying model of a formation is graphical. We first analyze the rigidity and persistence of meta-formations, which are formations obtained by connecting several rigid or persistent formations. Persistence is a generalization to directed graphs of the undirected notion of rigidity. In the context of moving autonomous agent f… ▽ More This paper treats the problem of the merging of formations, where the underlying model of a formation is graphical. We first analyze the rigidity and persistence of meta-formations, which are formations obtained by connecting several rigid or persistent formations. Persistence is a generalization to directed graphs of the undirected notion of rigidity. In the context of moving autonomous agent formations, persistence characterizes the efficacy of a directed structure of unilateral distance constraints seeking to preserve a formation shape. We derive then, for agents evolving in a two- or three-dimensional space, the conditions under which a set of persistent formations can be merged into a persistent meta-formation, and give the minimal number of interconnections needed for such a merging. We also give conditions for a meta-formation obtained by merging several persistent formations to be persistent. △ Less

Submitted 14 October, 2007; originally announced October 2007.

Comments: 1 zip file containing 1 .tex files, and 39 .eps files. The paper (including the appendix) contains 13 Figures

Linear time algorithms for Clobber

Authors: Vincent D. Blondel, Julien M. Hendrickx, Raphael M. Jungers

Abstract: We prove that the single-player game clobber is solvable in linear time when played on a line or on a cycle. For this purpose, we show that this game is equivalent to an optimization problem on a set of words defined by seven classes of forbidden patterns. We also prove that, playing on the cycle, it is always possible to remove at least 2n/3 pawns, and we give a conformation for which it is not… ▽ More We prove that the single-player game clobber is solvable in linear time when played on a line or on a cycle. For this purpose, we show that this game is equivalent to an optimization problem on a set of words defined by seven classes of forbidden patterns. We also prove that, playing on the cycle, it is always possible to remove at least 2n/3 pawns, and we give a conformation for which it is not possible to do better, answering questions recently asked by Faria et al. △ Less

Submitted 12 March, 2007; originally announced March 2007.

Primitive operations for the construction and reorganization of minimally persistent formations

Authors: Julien M. Hendrickx, Baris Fidan, Changbin Yu, Brian D. O. Anderson, Vincent D. Blondel

Abstract: In this paper, we study the construction and transformation of two-dimensional persistent graphs. Persistence is a generalization to directed graphs of the undirected notion of rigidity. In the context of moving autonomous agent formations, persistence characterizes the efficacy of a directed structure of unilateral distances constraints seeking to preserve a formation shape. Analogously to the… ▽ More In this paper, we study the construction and transformation of two-dimensional persistent graphs. Persistence is a generalization to directed graphs of the undirected notion of rigidity. In the context of moving autonomous agent formations, persistence characterizes the efficacy of a directed structure of unilateral distances constraints seeking to preserve a formation shape. Analogously to the powerful results about Henneberg sequences in minimal rigidity theory, we propose different types of directed graph operations allowing one to sequentially build any minimally persistent graph (i.e. persistent graph with a minimal number of edges for a given number of vertices), each intermediate graph being also minimally persistent. We also consider the more generic problem of obtaining one minimally persistent graph from another, which corresponds to the on-line reorganization of an autonomous agent formation. We prove that we can obtain any minimally persistent formation from any other one by a sequence of elementary local operations such that minimal persistence is preserved throughout the reorganization process. △ Less

Submitted 8 September, 2006; originally announced September 2006.

Comments: 26 pages, 31 .eps files for the figures

Report number: CESAME research report 2006.62