-
A pasting lemma for Lipschitz functions
Authors:
Matthew D. Kvalheim,
Paul Gustafson,
Samuel A. Burden
Abstract:
We give a necessary and sufficient condition ensuring that any function which is separately Lipschitz on two fixed compact sets is Lipschitz on their union.
We give a necessary and sufficient condition ensuring that any function which is separately Lipschitz on two fixed compact sets is Lipschitz on their union.
△ Less
Submitted 16 September, 2021;
originally announced September 2021.
-
Representing and computing the B-derivative of an $EC^r$ vector field's $PC^r$ flow
Authors:
George Council,
Shai Revzen,
Samuel A. Burden
Abstract:
This paper concerns the first-order approximation of the piecewise-differentiable flow generated by a class of nonsmooth vector fields. Specifically, we represent and compute the Bouligand (or B-)derivative of the piecewise-$C^r$ flow generated by an event-selected $C^r$ vector field. Our results are remarkably efficient: although there are factorially many "pieces" of the desired derivative, we p…
▽ More
This paper concerns the first-order approximation of the piecewise-differentiable flow generated by a class of nonsmooth vector fields. Specifically, we represent and compute the Bouligand (or B-)derivative of the piecewise-$C^r$ flow generated by an event-selected $C^r$ vector field. Our results are remarkably efficient: although there are factorially many "pieces" of the desired derivative, we provide an algorithm that evaluates its action on a given tangent vector using polynomial time and space, and verify the algorithm's correctness by deriving a representation for the B-derivative that requires "only" exponential time and space to construct. We apply our methods in two classes of illustrative examples: piecewise-constant vector fields and mechanical systems subject to unilateral constraints.
△ Less
Submitted 7 March, 2021; v1 submitted 21 February, 2021;
originally announced February 2021.
-
Convergence Analysis of Gradient-Based Learning with Non-Uniform Learning Rates in Non-Cooperative Multi-Agent Settings
Authors:
Benjamin Chasnov,
Lillian J. Ratliff,
Eric Mazumdar,
Samuel A. Burden
Abstract:
Considering a class of gradient-based multi-agent learning algorithms in non-cooperative settings, we provide local convergence guarantees to a neighborhood of a stable local Nash equilibrium. In particular, we consider continuous games where agents learn in (i) deterministic settings with oracle access to their gradient and (ii) stochastic settings with an unbiased estimator of their gradient. Ut…
▽ More
Considering a class of gradient-based multi-agent learning algorithms in non-cooperative settings, we provide local convergence guarantees to a neighborhood of a stable local Nash equilibrium. In particular, we consider continuous games where agents learn in (i) deterministic settings with oracle access to their gradient and (ii) stochastic settings with an unbiased estimator of their gradient. Utilizing the minimum and maximum singular values of the game Jacobian, we provide finite-time convergence guarantees in the deterministic case. On the other hand, in the stochastic case, we provide concentration bounds guaranteeing that with high probability agents will converge to a neighborhood of a stable local Nash equilibrium in finite time. Different than other works in this vein, we also study the effects of non-uniform learning rates on the learning dynamics and convergence rates. We find that much like preconditioning in optimization, non-uniform learning rates cause a distortion in the vector field which can, in turn, change the rate of convergence and the shape of the region of attraction. The analysis is supported by numerical examples that illustrate different aspects of the theory. We conclude with discussion of the results and open questions.
△ Less
Submitted 30 May, 2019;
originally announced June 2019.
-
Offline state estimation for hybrid systems via nonsmooth variable projection
Authors:
Jize Zhang,
Andrew M. Pace,
Samuel A. Burden,
Aleksandr Aravkin
Abstract:
A hybrid dynamical system switches between dynamic regimes at time- or state-triggered events. We propose an offline algorithm that simultaneously estimates discrete and continuous components of a hybrid system's state. We formulate state estimation as a continuous optimization problem by relaxing the discrete component and use a robust loss function to accommodate large changes in the continuous…
▽ More
A hybrid dynamical system switches between dynamic regimes at time- or state-triggered events. We propose an offline algorithm that simultaneously estimates discrete and continuous components of a hybrid system's state. We formulate state estimation as a continuous optimization problem by relaxing the discrete component and use a robust loss function to accommodate large changes in the continuous component during switching events. Subsequently, we develop a novel nonsmooth variable projection algorithm with Gauss-Newton updates to solve the state estimation problem and prove the algorithm's global convergence to stationary points. We demonstrate the effectiveness of our approach on simple piecewise-linear and -nonlinear mechanical systems undergoing intermittent impact.
△ Less
Submitted 22 May, 2019;
originally announced May 2019.
-
Generalizing infinitesimal contraction analysis to hybrid systems
Authors:
Samuel A Burden,
Samuel D Coogan
Abstract:
Infinitesimal contraction analysis, wherein global asymptotic convergence results are obtained from local dynamical properties, has proven to be a powerful tool for applications in biological, mechanical, and transportation systems. Thus far, the technique has been restricted to systems governed by a single smooth differential or difference equation. We generalize infinitesimal contraction analysi…
▽ More
Infinitesimal contraction analysis, wherein global asymptotic convergence results are obtained from local dynamical properties, has proven to be a powerful tool for applications in biological, mechanical, and transportation systems. Thus far, the technique has been restricted to systems governed by a single smooth differential or difference equation. We generalize infinitesimal contraction analysis to hybrid systems governed by interacting differential and difference equations. Our theoretical results are illustrated on a series of examples.
△ Less
Submitted 11 April, 2018;
originally announced April 2018.
-
Computing the Bouligand derivative of a class of piecewise-differentiable flows
Authors:
Shai Revzen,
Samuel A Burden
Abstract:
Event--selected $C^r$ vector fields yield piecewise-differentiable flows, which possess a continuous and piecewise-linear Bouligand (or B-)derivative; here we provide an algorithm for computing this B-derivative. The number of "pieces" of the piecewise-linear B-derivative is factorial ($d!$) in the dimension ($d$) of the space, precluding a polynomial-time algorithm. We show how an exponential num…
▽ More
Event--selected $C^r$ vector fields yield piecewise-differentiable flows, which possess a continuous and piecewise-linear Bouligand (or B-)derivative; here we provide an algorithm for computing this B-derivative. The number of "pieces" of the piecewise-linear B-derivative is factorial ($d!$) in the dimension ($d$) of the space, precluding a polynomial-time algorithm. We show how an exponential number ($2^d$) of points can be used to represent the B-derivative as a piecewise-linear homeomorphism in such a way that evaluating the derivative reduces to linear algebra computations involving a matrix constructed from $d$ of these points.
△ Less
Submitted 8 December, 2016;
originally announced December 2016.
-
Piecewise-differentiable trajectory outcomes in mechanical systems subject to unilateral constraints
Authors:
Andrew M. Pace,
Samuel A. Burden
Abstract:
We provide conditions under which trajectory outcomes in mechanical systems subject to unilateral constraints depend piecewise-differentiably on initial conditions, even as the sequence of constraint activations and deactivations varies. This builds on prior work that provided conditions ensuring existence, uniqueness, and continuity of trajectory outcomes, and extends previous differentiability r…
▽ More
We provide conditions under which trajectory outcomes in mechanical systems subject to unilateral constraints depend piecewise-differentiably on initial conditions, even as the sequence of constraint activations and deactivations varies. This builds on prior work that provided conditions ensuring existence, uniqueness, and continuity of trajectory outcomes, and extends previous differentiability results that applied only to fixed constraint (de)activation sequences. We discuss extensions of our result and implications for assessing stability and controllability.
△ Less
Submitted 17 October, 2016;
originally announced October 2016.
-
A Hybrid Dynamical Extension of Averaging
Authors:
Avik De,
Samuel A. Burden,
Daniel E. Koditschek
Abstract:
We extend a smooth dynamical systems averaging technique to a class of hybrid systems with a limit cycle that is particularly relevant to the synthesis of stable legged gaits. After introducing a definition of hybrid averageability sufficient to recover the classical result, we provide a simple illustration of its applicability to legged locomotion and conclude with some rather more speculative re…
▽ More
We extend a smooth dynamical systems averaging technique to a class of hybrid systems with a limit cycle that is particularly relevant to the synthesis of stable legged gaits. After introducing a definition of hybrid averageability sufficient to recover the classical result, we provide a simple illustration of its applicability to legged locomotion and conclude with some rather more speculative remarks concerning the prospects for further generalization of these ideas.
△ Less
Submitted 13 July, 2016;
originally announced July 2016.
-
On the Characterization of Local Nash Equilibria in Continuous Games
Authors:
Lillian J. Ratliff,
Samuel A. Burden,
S. Shankar Sastry
Abstract:
We present a unified framework for characterizing local Nash equilibria in continuous games on either infinite-dimensional or finite-dimensional non-convex strategy spaces. We provide intrinsic necessary and sufficient first- and second-order conditions ensuring strategies constitute local Nash equilibria. We term points satisfying the sufficient conditions differential Nash equilibria. Further, w…
▽ More
We present a unified framework for characterizing local Nash equilibria in continuous games on either infinite-dimensional or finite-dimensional non-convex strategy spaces. We provide intrinsic necessary and sufficient first- and second-order conditions ensuring strategies constitute local Nash equilibria. We term points satisfying the sufficient conditions differential Nash equilibria. Further, we provide a sufficient condition (non-degeneracy) guaranteeing differential Nash equilibria are isolated and show that such equilibria are structurally stable. We present tutorial examples to illustrate our results and highlight degeneracies that can arise in continuous games.
△ Less
Submitted 8 November, 2014;
originally announced November 2014.
-
Approximation Algorithms for Optimization of Combinatorial Dynamical Systems
Authors:
Insoon Yang,
Samuel A. Burden,
Ram Rajagopal,
S. Shankar Sastry,
Claire J. Tomlin
Abstract:
This paper considers an optimization problem for a dynamical system whose evolution depends on a collection of binary decision variables. We develop scalable approximation algorithms with provable suboptimality bounds to provide computationally tractable solution methods even when the dimension of the system and the number of the binary variables are large. The proposed method employs a linear app…
▽ More
This paper considers an optimization problem for a dynamical system whose evolution depends on a collection of binary decision variables. We develop scalable approximation algorithms with provable suboptimality bounds to provide computationally tractable solution methods even when the dimension of the system and the number of the binary variables are large. The proposed method employs a linear approximation of the objective function such that the approximate problem is defined over the feasible space of the binary decision variables, which is a discrete set. To define such a linear approximation, we propose two different variation methods: one uses continuous relaxation of the discrete space and the other uses convex combinations of the vector field and running payoff. The approximate problem is a 0-1 linear program, which can be solved by existing polynomial-time exact or approximation algorithms, and does not require the solution of the dynamical system. Furthermore, we characterize a sufficient condition ensuring the approximate solution has a provable suboptimality bound. We show that this condition can be interpreted as the concavity of the objective function. The performance and utility of the proposed algorithms are demonstrated with the ON/OFF control problems of interdependent refrigeration systems.
△ Less
Submitted 7 January, 2015; v1 submitted 27 September, 2014;
originally announced September 2014.
-
Event-Selected Vector Field Discontinuities Yield Piecewise-Differentiable Flows
Authors:
Samuel A. Burden,
S. Shankar Sastry,
Daniel E. Koditschek,
Shai Revzen
Abstract:
We study a class of discontinuous vector fields brought to our attention by multi-legged animal locomotion. Such vector fields arise not only in biomechanics, but also in robotics, neuroscience, and electrical engineering, to name a few domains of application. Under the conditions that (i) the vector field's discontinuities are locally confined to a finite number of smooth submanifolds and (ii) th…
▽ More
We study a class of discontinuous vector fields brought to our attention by multi-legged animal locomotion. Such vector fields arise not only in biomechanics, but also in robotics, neuroscience, and electrical engineering, to name a few domains of application. Under the conditions that (i) the vector field's discontinuities are locally confined to a finite number of smooth submanifolds and (ii) the vector field is transverse to these surfaces in an appropriate sense, we show that the vector field yields a well-defined flow that is Lipschitz continuous and piecewise-differentiable. This implies that although the flow is not classically differentiable, nevertheless it admits a first-order approximation (known as a Bouligand derivative) that is piecewise-linear and continuous at every point. We exploit this first-order approximation to infer existence of piecewise-differentiable impact maps (including Poincaré maps for periodic orbits), show the flow is locally conjugate (via a piecewise-differentiable homeomorphism) to a flowbox, and assess the effect of perturbations (both infinitesimal and non-infinitesimal) on the flow. We use these results to give a sufficient condition for the exponential stability of a periodic orbit passing through a point of multiply intersecting events, and apply the theory in illustrative examples to demonstrate synchronization in abstract first- and second-order phase oscillator models.
△ Less
Submitted 22 April, 2015; v1 submitted 7 July, 2014;
originally announced July 2014.
-
Model Reduction Near Periodic Orbits of Hybrid Dynamical Systems
Authors:
Samuel A. Burden,
Shai Revzen,
S. Shankar Sastry
Abstract:
We show that, near periodic orbits, a class of hybrid models can be reduced to or approximated by smooth continuous-time dynamical systems. Specifically, near an exponentially stable periodic orbit undergoing isolated transitions in a hybrid dynamical system, nearby executions generically contract superexponentially to a constant-dimensional subsystem. Under a non-degeneracy condition on the rank…
▽ More
We show that, near periodic orbits, a class of hybrid models can be reduced to or approximated by smooth continuous-time dynamical systems. Specifically, near an exponentially stable periodic orbit undergoing isolated transitions in a hybrid dynamical system, nearby executions generically contract superexponentially to a constant-dimensional subsystem. Under a non-degeneracy condition on the rank deficiency of the associated Poincare map, the contraction occurs in finite time regardless of the stability properties of the orbit. Hybrid transitions may be removed from the resulting subsystem via a topological quotient that admits a smooth structure to yield an equivalent smooth dynamical system. We demonstrate reduction of a high-dimensional underactuated mechanical model for terrestrial locomotion, assess structural stability of deadbeat controllers for rhythmic locomotion and manipulation, and derive a normal form for the stability basin of a hybrid oscillator. These applications illustrate the utility of our theoretical results for synthesis and analysis of feedback control laws for rhythmic hybrid behavior.
△ Less
Submitted 7 January, 2015; v1 submitted 19 August, 2013;
originally announced August 2013.
