-
Almost Sure Convergence and Non-asymptotic Concentration Bounds for Stochastic Mirror Descent Algorithm
Authors:
Anik Kumar Paul,
Arun D Mahindrakar,
Rachel K Kalaimani
Abstract:
This letter investigates the convergence and concentration properties of the Stochastic Mirror Descent (SMD) algorithm utilizing biased stochastic subgradients. We establish the almost sure convergence of the algorithm's iterates under the assumption of diminishing bias. Furthermore, we derive concentration bounds for the discrepancy between the iterates' function values and the optimal value, bas…
▽ More
This letter investigates the convergence and concentration properties of the Stochastic Mirror Descent (SMD) algorithm utilizing biased stochastic subgradients. We establish the almost sure convergence of the algorithm's iterates under the assumption of diminishing bias. Furthermore, we derive concentration bounds for the discrepancy between the iterates' function values and the optimal value, based on standard assumptions. Subsequently, leveraging the assumption of Sub-Gaussian noise in stochastic subgradients, we present refined concentration bounds for this discrepancy.
△ Less
Submitted 8 July, 2024;
originally announced July 2024.
-
Convergence Analysis of Stochastic Saddle Point Mirror Descent Algorithm -- A Projected Dynamical View Point
Authors:
Anik Kumar Paul,
Arun D Mahindrakar,
Rachel K Kalaimani
Abstract:
Saddle point problems, ubiquitous in optimization, extend beyond game theory to diverse domains like power networks and reinforcement learning. This paper presents novel approaches to tackle saddle point problem, with a focus on continuous-time contexts. In this paper we propose a continuous time dynamics to tackle saddle point problem utilizing projected dynamical system in non-Euclidean domain.…
▽ More
Saddle point problems, ubiquitous in optimization, extend beyond game theory to diverse domains like power networks and reinforcement learning. This paper presents novel approaches to tackle saddle point problem, with a focus on continuous-time contexts. In this paper we propose a continuous time dynamics to tackle saddle point problem utilizing projected dynamical system in non-Euclidean domain. This involves computing the (sub/super) gradient of the min-max function within a Riemannian metric. Additionally, we establish viable Caratheodory solutions also prove the Lyapunov stability and asymptotic set stability of the proposed continuous time dynamical system. Next, we present the Stochastic Saddle Point Mirror Descent (SSPMD) algorithm and establish its equivalence with the proposed continuous-time dynamics. Leveraging stability analysis of the continuous-time dynamics, we demonstrate the almost sure convergence of the algorithm's iterates. Furthermore, we introduce the Zeroth-Order Saddle Point Mirror Descent (SZSPMD) algorithm, which approximates gradients using Nesterov's Gaussian Approximation, showcasing convergence to a neighborhood around saddle points. The analysis in this paper provides geometric insights into the mirror descent algorithm and demonstrates how these insights offer theoretical foundations for various practical applications of the mirror descent algorithm in diverse scenarios.
△ Less
Submitted 7 April, 2024;
originally announced April 2024.
-
Dynamical System Approach for Time-Varying Constrained Convex Optimization Problems
Authors:
Rejitha Raveendran,
Arun D. Mahindrakar,
Umesh Vaidya
Abstract:
Optimization problems emerging in most of the real-world applications are dynamic, where either the objective function or the constraints change continuously over time. This paper proposes projected primal-dual dynamical system approaches to track the primal and dual optimizer trajectories of an inequality constrained time-varying (TV) convex optimization problem with a strongly convex objective f…
▽ More
Optimization problems emerging in most of the real-world applications are dynamic, where either the objective function or the constraints change continuously over time. This paper proposes projected primal-dual dynamical system approaches to track the primal and dual optimizer trajectories of an inequality constrained time-varying (TV) convex optimization problem with a strongly convex objective function. First, we present a dynamical system that asymptotically tracks the optimizer trajectory of an inequality constrained TV optimization problem. Later we modify the proposed dynamics to achieve the convergence to the optimizer trajectory within a fixed time. The asymptotic and fixed-time convergence of the proposed dynamical systems to the optimizer trajectory is shown via Lyapunov based analysis. Finally, we consider the TV extended Fermat -Torricelli problem (eFTP) of minimizing the sum-of-squared distances to a finite number of nonempty, closed and convex TV sets, to illustrate the applicability of the projected dynamical systems proposed in this paper.
△ Less
Submitted 15 December, 2023;
originally announced December 2023.
-
Robust Analysis of Almost Sure Convergence of Zeroth-Order Mirror Descent Algorithm
Authors:
Anik Kumar Paul,
Arun D Mahindrakar,
Rachel K Kalaimani
Abstract:
This letter presents an almost sure convergence of the zeroth-order mirror descent algorithm. The algorithm admits non-smooth convex functions and a biased oracle which only provides noisy function value at any desired point. We approximate the subgradient of the objective function using Nesterov's Gaussian Approximation (NGA) with certain alternations suggested by some practical applications. We…
▽ More
This letter presents an almost sure convergence of the zeroth-order mirror descent algorithm. The algorithm admits non-smooth convex functions and a biased oracle which only provides noisy function value at any desired point. We approximate the subgradient of the objective function using Nesterov's Gaussian Approximation (NGA) with certain alternations suggested by some practical applications. We prove an almost sure convergence of the iterates' function value to the neighbourhood of optimal function value, which can not be made arbitrarily small, a manifestation of a biased oracle. This letter ends with a concentration inequality, which is a finite time analysis that predicts the likelihood that the function value of the iterates is in the neighbourhood of the optimal value at any finite iteration.
△ Less
Submitted 30 June, 2024; v1 submitted 17 March, 2023;
originally announced March 2023.
-
Event-triggered Control for Nonlinear Systems with Center Manifolds
Authors:
Akshit Saradagi,
Vijay Muralidharan,
Arun D. Mahindrakar,
Pavankumar Tallapragada
Abstract:
In this work, we consider the problem of event-triggered implementation of control laws designed for the local stabilization of nonlinear systems with center manifolds. We propose event-triggering conditions which are derived from a local input-to-state stability characterization of such systems. The triggering conditions ensure local ultimate boundedness of the trajectories and the existence of a…
▽ More
In this work, we consider the problem of event-triggered implementation of control laws designed for the local stabilization of nonlinear systems with center manifolds. We propose event-triggering conditions which are derived from a local input-to-state stability characterization of such systems. The triggering conditions ensure local ultimate boundedness of the trajectories and the existence of a uniform positive lower bound for the inter-event times. The ultimate bound can be made arbitrarily small, but by allowing for smaller inter-event times. Under certain assumptions on the controller structure, local asymptotic stability of the origin is also guaranteed. Two sets of triggering conditions are proposed, that cater to the cases where the exact center manifold and only an approximation of the center manifold is computable. The closed-loop system exhibits some desirable properties when the exact knowledge of the center manifold is employed in checking the triggering conditions. Three illustrative examples that explore different scenarios are presented and the applicability of the proposed methods is demonstrated. The third example concerns the event-triggered implementation of a position stabilizing controller for the open-loop unstable Mobile Inverted Pendulum (MIP) robot.
△ Less
Submitted 20 October, 2021;
originally announced October 2021.
-
Position and line-of-sight stabilization of spherical robot using feedforward proportional-derivative geometric controller
Authors:
Krishna Chaitanya Kosaraju,
Arun D. Mahindrakar,
Vijay Muralidharan,
Anup K. Ekbote,
Ramkrishna Pasumarthy
Abstract:
In this paper we present a geometric control law for position and line-of-sight stabilization of the nonholonomic spherical robot actuated by three independent actuators. A simple configuration error function with an appropriately defined transport map is proposed to extract feedforward and proportional-derivative control law. Simulations are provided to validate the controller performance.
In this paper we present a geometric control law for position and line-of-sight stabilization of the nonholonomic spherical robot actuated by three independent actuators. A simple configuration error function with an appropriately defined transport map is proposed to extract feedforward and proportional-derivative control law. Simulations are provided to validate the controller performance.
△ Less
Submitted 16 May, 2017;
originally announced May 2017.
-
Complex Laplacian based Distributed Control for Multi-Agent Network
Authors:
Aniket Deshpande,
Pushpak Jagtap,
Prashant Bansode,
Arun Mahindrakar,
Navadeep Singh
Abstract:
The work done in this paper, proposes a complex Laplacian-based distributed control scheme for convergence in the multi-agent network. The proposed scheme has been designated as cascade formulation. The proposed technique exploits the traditional method of organizing large scattered networks into smaller interconnected clusters to optimize information flow within the network. The complex Laplacian…
▽ More
The work done in this paper, proposes a complex Laplacian-based distributed control scheme for convergence in the multi-agent network. The proposed scheme has been designated as cascade formulation. The proposed technique exploits the traditional method of organizing large scattered networks into smaller interconnected clusters to optimize information flow within the network. The complex Laplacian-based approach results in a hierarchical structure, with formation of a meta-cluster leading other clusters in the network. The proposed formulation enables flexibility to constrain the eigen spectra of the overall closed-loop dynamics, ensuring desired convergence rate and control input intensity. The sufficient conditions ensuring globally stable formation for proposed formulation are also asserted. Robustness of the proposed formulation to uncertainties like loss in communication links and actuator failure has also been discussed. The effectiveness of the proposed approach is illustrated by simulating a finitely large network of thirty vehicles.
△ Less
Submitted 12 July, 2018; v1 submitted 18 September, 2016;
originally announced September 2016.
-
Synchronization and semistability analysis of the Kuramoto model of coupled nonlinear oscillators
Authors:
Vishaal Krishnan,
Arun D. Mahindrakar,
Somashekhar S. Hiremath
Abstract:
An interesting problem in synchronization is the study of coupled oscillators, wherein oscillators with different natural frequencies synchronize to a common frequency and equilibrium phase difference. In this paper, we investigate the stability and convergence in a network of coupled oscillators described by the Kuramoto model. We consider networks with finite number of oscillators, arbitrary int…
▽ More
An interesting problem in synchronization is the study of coupled oscillators, wherein oscillators with different natural frequencies synchronize to a common frequency and equilibrium phase difference. In this paper, we investigate the stability and convergence in a network of coupled oscillators described by the Kuramoto model. We consider networks with finite number of oscillators, arbitrary interconnection topology, non-uniform coupling gains and non-identical natural frequencies. We show that such a network synchronizes provided the underlying graph is connected and certain conditions on the coupling gains are satisfied. In the analysis, we consider as states the phase and angular frequency differences between the oscillators, and the resulting dynamics possesses a continuum of equilibria. The synchronization problem involves establishing the Lyapunov stability of the fixed points and showing convergence of trajectories to these points. The synchronization result is established in the framework of semistability theory.
△ Less
Submitted 10 May, 2014; v1 submitted 2 October, 2013;
originally announced October 2013.
