Showing 1–9 of 9 results for author: Mahindrakar, A D

Almost Sure Convergence and Non-asymptotic Concentration Bounds for Stochastic Mirror Descent Algorithm

Authors: Anik Kumar Paul, Arun D Mahindrakar, Rachel K Kalaimani

Abstract: This letter investigates the convergence and concentration properties of the Stochastic Mirror Descent (SMD) algorithm utilizing biased stochastic subgradients. We establish the almost sure convergence of the algorithm's iterates under the assumption of diminishing bias. Furthermore, we derive concentration bounds for the discrepancy between the iterates' function values and the optimal value, bas… ▽ More This letter investigates the convergence and concentration properties of the Stochastic Mirror Descent (SMD) algorithm utilizing biased stochastic subgradients. We establish the almost sure convergence of the algorithm's iterates under the assumption of diminishing bias. Furthermore, we derive concentration bounds for the discrepancy between the iterates' function values and the optimal value, based on standard assumptions. Subsequently, leveraging the assumption of Sub-Gaussian noise in stochastic subgradients, we present refined concentration bounds for this discrepancy. △ Less

Submitted 8 July, 2024; originally announced July 2024.

Convergence Analysis of Stochastic Saddle Point Mirror Descent Algorithm -- A Projected Dynamical View Point

Authors: Anik Kumar Paul, Arun D Mahindrakar, Rachel K Kalaimani

Abstract: Saddle point problems, ubiquitous in optimization, extend beyond game theory to diverse domains like power networks and reinforcement learning. This paper presents novel approaches to tackle saddle point problem, with a focus on continuous-time contexts. In this paper we propose a continuous time dynamics to tackle saddle point problem utilizing projected dynamical system in non-Euclidean domain.… ▽ More Saddle point problems, ubiquitous in optimization, extend beyond game theory to diverse domains like power networks and reinforcement learning. This paper presents novel approaches to tackle saddle point problem, with a focus on continuous-time contexts. In this paper we propose a continuous time dynamics to tackle saddle point problem utilizing projected dynamical system in non-Euclidean domain. This involves computing the (sub/super) gradient of the min-max function within a Riemannian metric. Additionally, we establish viable Caratheodory solutions also prove the Lyapunov stability and asymptotic set stability of the proposed continuous time dynamical system. Next, we present the Stochastic Saddle Point Mirror Descent (SSPMD) algorithm and establish its equivalence with the proposed continuous-time dynamics. Leveraging stability analysis of the continuous-time dynamics, we demonstrate the almost sure convergence of the algorithm's iterates. Furthermore, we introduce the Zeroth-Order Saddle Point Mirror Descent (SZSPMD) algorithm, which approximates gradients using Nesterov's Gaussian Approximation, showcasing convergence to a neighborhood around saddle points. The analysis in this paper provides geometric insights into the mirror descent algorithm and demonstrates how these insights offer theoretical foundations for various practical applications of the mirror descent algorithm in diverse scenarios. △ Less

Submitted 7 April, 2024; originally announced April 2024.

Dynamical System Approach for Time-Varying Constrained Convex Optimization Problems

Authors: Rejitha Raveendran, Arun D. Mahindrakar, Umesh Vaidya

Abstract: Optimization problems emerging in most of the real-world applications are dynamic, where either the objective function or the constraints change continuously over time. This paper proposes projected primal-dual dynamical system approaches to track the primal and dual optimizer trajectories of an inequality constrained time-varying (TV) convex optimization problem with a strongly convex objective f… ▽ More Optimization problems emerging in most of the real-world applications are dynamic, where either the objective function or the constraints change continuously over time. This paper proposes projected primal-dual dynamical system approaches to track the primal and dual optimizer trajectories of an inequality constrained time-varying (TV) convex optimization problem with a strongly convex objective function. First, we present a dynamical system that asymptotically tracks the optimizer trajectory of an inequality constrained TV optimization problem. Later we modify the proposed dynamics to achieve the convergence to the optimizer trajectory within a fixed time. The asymptotic and fixed-time convergence of the proposed dynamical systems to the optimizer trajectory is shown via Lyapunov based analysis. Finally, we consider the TV extended Fermat -Torricelli problem (eFTP) of minimizing the sum-of-squared distances to a finite number of nonempty, closed and convex TV sets, to illustrate the applicability of the projected dynamical systems proposed in this paper. △ Less

Submitted 15 December, 2023; originally announced December 2023.

Robust Analysis of Almost Sure Convergence of Zeroth-Order Mirror Descent Algorithm

Authors: Anik Kumar Paul, Arun D Mahindrakar, Rachel K Kalaimani

Abstract: This letter presents an almost sure convergence of the zeroth-order mirror descent algorithm. The algorithm admits non-smooth convex functions and a biased oracle which only provides noisy function value at any desired point. We approximate the subgradient of the objective function using Nesterov's Gaussian Approximation (NGA) with certain alternations suggested by some practical applications. We… ▽ More This letter presents an almost sure convergence of the zeroth-order mirror descent algorithm. The algorithm admits non-smooth convex functions and a biased oracle which only provides noisy function value at any desired point. We approximate the subgradient of the objective function using Nesterov's Gaussian Approximation (NGA) with certain alternations suggested by some practical applications. We prove an almost sure convergence of the iterates' function value to the neighbourhood of optimal function value, which can not be made arbitrarily small, a manifestation of a biased oracle. This letter ends with a concentration inequality, which is a finite time analysis that predicts the likelihood that the function value of the iterates is in the neighbourhood of the optimal value at any finite iteration. △ Less

Submitted 30 June, 2024; v1 submitted 17 March, 2023; originally announced March 2023.

A Unified Framework for Consensus and Synchronization on Lie Groups admitting a Bi-Invariant Metric

Authors: Rama Seshan Chandrasekharan, Ravi N Banavar, Arun D Mahindrakar

Abstract: For a finite number of agents evolving on a Euclidean space and linked to each other by a connected graph, the Laplacian flow that is based on the inter-agent errors, ensures consensus or synchronization for both first and second-order dynamics. When such agents evolve on a circle (the Kuramoto oscillator), the flow that depends on the sinusoid of the inter-agent error angles generalizes the same.… ▽ More For a finite number of agents evolving on a Euclidean space and linked to each other by a connected graph, the Laplacian flow that is based on the inter-agent errors, ensures consensus or synchronization for both first and second-order dynamics. When such agents evolve on a circle (the Kuramoto oscillator), the flow that depends on the sinusoid of the inter-agent error angles generalizes the same. In this work, it is shown that the Laplacian flow and the Kuramoto oscillator are special cases of a more general theory of consensus on Lie groups that admit bi-invariant metrics. Such a theory not only enables generalization of these consensus and synchronization algorithms to Lie groups but also provide insight on to the abstract group theoretic and differential geometric properties that ensures convergence in Euclidean space and the circle. △ Less

Submitted 2 September, 2022; v1 submitted 1 September, 2022; originally announced September 2022.

Geometric PID Controller for Stabilization of Nonholonomic Mechanical Systems on Lie Groups

Authors: Rama Seshan, Ravi N Banavar, D. H. S. Maithripala, Arun D. Mahindrakar

Abstract: The PID controller is an elegant and versatile controller for set point tracking in double integrator systems of which mechanical systems evolving on Euclidean space constitute a large class. But since mechanical systems are typically constrained interconnections of rigid bodies whose configuration space is $SE(3)$, which is not even topologically Euclidean, a geometric PID controller has been dev… ▽ More The PID controller is an elegant and versatile controller for set point tracking in double integrator systems of which mechanical systems evolving on Euclidean space constitute a large class. But since mechanical systems are typically constrained interconnections of rigid bodies whose configuration space is $SE(3)$, which is not even topologically Euclidean, a geometric PID controller has been developed for mechanical systems evolving on Lie groups. In this work, we extend the framework to such systems which have nonholonomic constraints. It encompasses many practically applicable mechanical systems encountered in robotics as robots are constrained interconnections of rigid bodies where the constraints could either be holonomic or nonholonomic. △ Less

Submitted 13 November, 2021; originally announced November 2021.

Event-triggered Control for Nonlinear Systems with Center Manifolds

Authors: Akshit Saradagi, Vijay Muralidharan, Arun D. Mahindrakar, Pavankumar Tallapragada

Abstract: In this work, we consider the problem of event-triggered implementation of control laws designed for the local stabilization of nonlinear systems with center manifolds. We propose event-triggering conditions which are derived from a local input-to-state stability characterization of such systems. The triggering conditions ensure local ultimate boundedness of the trajectories and the existence of a… ▽ More In this work, we consider the problem of event-triggered implementation of control laws designed for the local stabilization of nonlinear systems with center manifolds. We propose event-triggering conditions which are derived from a local input-to-state stability characterization of such systems. The triggering conditions ensure local ultimate boundedness of the trajectories and the existence of a uniform positive lower bound for the inter-event times. The ultimate bound can be made arbitrarily small, but by allowing for smaller inter-event times. Under certain assumptions on the controller structure, local asymptotic stability of the origin is also guaranteed. Two sets of triggering conditions are proposed, that cater to the cases where the exact center manifold and only an approximation of the center manifold is computable. The closed-loop system exhibits some desirable properties when the exact knowledge of the center manifold is employed in checking the triggering conditions. Three illustrative examples that explore different scenarios are presented and the applicability of the proposed methods is demonstrated. The third example concerns the event-triggered implementation of a position stabilizing controller for the open-loop unstable Mobile Inverted Pendulum (MIP) robot. △ Less

Submitted 20 October, 2021; originally announced October 2021.

Comments: Submitted to IEEE Transactions on Automatic Control as a Full paper (Under review). 16 Pages, 4 Figures

Position and line-of-sight stabilization of spherical robot using feedforward proportional-derivative geometric controller

Authors: Krishna Chaitanya Kosaraju, Arun D. Mahindrakar, Vijay Muralidharan, Anup K. Ekbote, Ramkrishna Pasumarthy

Abstract: In this paper we present a geometric control law for position and line-of-sight stabilization of the nonholonomic spherical robot actuated by three independent actuators. A simple configuration error function with an appropriately defined transport map is proposed to extract feedforward and proportional-derivative control law. Simulations are provided to validate the controller performance. In this paper we present a geometric control law for position and line-of-sight stabilization of the nonholonomic spherical robot actuated by three independent actuators. A simple configuration error function with an appropriately defined transport map is proposed to extract feedforward and proportional-derivative control law. Simulations are provided to validate the controller performance. △ Less

Submitted 16 May, 2017; originally announced May 2017.

Comments: Published in Indian Control Conference, Indian Institute of Technology Madras, January 5-7, 2015. Chennai, India

Synchronization and semistability analysis of the Kuramoto model of coupled nonlinear oscillators

Authors: Vishaal Krishnan, Arun D. Mahindrakar, Somashekhar S. Hiremath

Abstract: An interesting problem in synchronization is the study of coupled oscillators, wherein oscillators with different natural frequencies synchronize to a common frequency and equilibrium phase difference. In this paper, we investigate the stability and convergence in a network of coupled oscillators described by the Kuramoto model. We consider networks with finite number of oscillators, arbitrary int… ▽ More An interesting problem in synchronization is the study of coupled oscillators, wherein oscillators with different natural frequencies synchronize to a common frequency and equilibrium phase difference. In this paper, we investigate the stability and convergence in a network of coupled oscillators described by the Kuramoto model. We consider networks with finite number of oscillators, arbitrary interconnection topology, non-uniform coupling gains and non-identical natural frequencies. We show that such a network synchronizes provided the underlying graph is connected and certain conditions on the coupling gains are satisfied. In the analysis, we consider as states the phase and angular frequency differences between the oscillators, and the resulting dynamics possesses a continuum of equilibria. The synchronization problem involves establishing the Lyapunov stability of the fixed points and showing convergence of trajectories to these points. The synchronization result is established in the framework of semistability theory. △ Less

Submitted 10 May, 2014; v1 submitted 2 October, 2013; originally announced October 2013.

Comments: 9 pages, 4 figures, Submitted to IEEE TCNS (under review)

MSC Class: 93D05; 92B25 (Primary) 37C10 (Secondary)