Showing 1–4 of 4 results for author: Fang, Y P

Solving maximally comonotone inclusion problems via an implicit Newton-like inertial dynamical system and its discretization

Authors: Z. Z. Tan, R. Hu, Y. P. Fang

Abstract: This paper deals with an implicit Newton-like inertial dynamical system governed by a maximally comonotone inclusion problem in a Hilbert space. Under suitable conditions, we establish not only pointwise estimates and integral estimates for the velocity and the value of the associated Yosida regularization operator along the trajectory of the system, but also the weak convergence of the trajectory… ▽ More This paper deals with an implicit Newton-like inertial dynamical system governed by a maximally comonotone inclusion problem in a Hilbert space. Under suitable conditions, we establish not only pointwise estimates and integral estimates for the velocity and the value of the associated Yosida regularization operator along the trajectory of the system, but also the weak convergence of the trajectory to a zero of the maximally comonotone operator. Moreover, a new inertial algorithm is developed via a time discretization of the proposed system. Our analysis reveals that the resulting discrete algorithm exhibits fast convergence properties matching the ones of the continuous time counterpart. Finally, the theoretical results are illustrated by numerical experiments. △ Less

Submitted 10 May, 2024; originally announced May 2024.

Non-ergodic convergence rate of an inertial accelerated primal-dual algorithm for saddle point problems

Authors: X. He, N. J. Huang, Y. P. Fang

Abstract: In this paper, we design an inertial accelerated primal-dual algorithm to address the convex-concave saddle point problem, which is formulated as $\min_{x}\max_{y} f(x) + \langle Kx, y \rangle - g(y)$. Remarkably, both functions $f$ and $g$ exhibit a composite structure, combining ``nonsmooth'' + ``smooth'' components. Under the assumption of partially strong convexity in the sense that $f$ is con… ▽ More In this paper, we design an inertial accelerated primal-dual algorithm to address the convex-concave saddle point problem, which is formulated as $\min_{x}\max_{y} f(x) + \langle Kx, y \rangle - g(y)$. Remarkably, both functions $f$ and $g$ exhibit a composite structure, combining ``nonsmooth'' + ``smooth'' components. Under the assumption of partially strong convexity in the sense that $f$ is convex and $g$ is strongly convex, we introduce a novel inertial accelerated primal-dual algorithm based on Nesterov's extrapolation. This algorithm can be reduced to two classical accelerated forward-backward methods for unconstrained optimization problem. We show that the proposed algorithm achieves a non-ergodic $\mathcal{O}(1/k^2)$ convergence rate, where $k$ represents the number of iterations. Several numerical experiments validate the efficiency of our proposed algorithm. △ Less

Submitted 16 April, 2024; v1 submitted 19 November, 2023; originally announced November 2023.

Accelerated linearized alternating direction method of multipliers with Nesterov extrapolation

Authors: X. He, N. J. Huang, Y. P. Fang

Abstract: The alternating direction method of multipliers (ADMM) has found widespread use in solving separable convex optimization problems. In this paper, by employing Nesterov extrapolation technique, we propose two families of accelerated linearized ADMMs for addressing two-block linearly constrained separable convex optimization problems where each block of the objective function exhibits a ``nonsmooth'… ▽ More The alternating direction method of multipliers (ADMM) has found widespread use in solving separable convex optimization problems. In this paper, by employing Nesterov extrapolation technique, we propose two families of accelerated linearized ADMMs for addressing two-block linearly constrained separable convex optimization problems where each block of the objective function exhibits a ``nonsmooth'' + ``smooth'' composite structure. Our proposed accelerated linearized ADMMs extend two classical Nesterov acceleration methods designed for unconstrained composite optimization problems to linearly constrained problems. These methods are capable of achieving non-ergodic convergence rates of $\mathcal{O}(1/k^2)$, provided that one block of the objective function exhibits strong convexity and the gradients of smooth terms are Lipschitz continuous. We show that the proposed methods can reduce to accelerated linearized augmented Lagrangian methods (ALMs) for solving one-block linearly constrained convex optimization problems. By choosing different extrapolation parameters, we explore the relationship between the proposed methods and some existing accelerated methods. Numerical results are presented to validate the efficacy and reliability of the proposed algorithms. △ Less

Submitted 9 May, 2024; v1 submitted 25 October, 2023; originally announced October 2023.

Tikhonov regularized second-order plus first-order primal-dual dynamical systems with asymptotically vanishing dam** for linear equality constrained convex optimization problems

Authors: Ting Ting Zhu, Rong Hu, Ya ** Fang

Abstract: In this paper, in the setting of Hilbert spaces, we consider a Tikhonov regularized second-order plus first-order primal-dual dynamical system with asymptotically vanishing dam** for a linear equality constrained convex optimization problem. The convergence properties of the proposed dynamical system depend heavily upon the choice of the Tikhonov regularization parameter. When the Tikhonov regul… ▽ More In this paper, in the setting of Hilbert spaces, we consider a Tikhonov regularized second-order plus first-order primal-dual dynamical system with asymptotically vanishing dam** for a linear equality constrained convex optimization problem. The convergence properties of the proposed dynamical system depend heavily upon the choice of the Tikhonov regularization parameter. When the Tikhonov regularization parameter decreases rapidly to zero, we establish the fast convergence rates of the primal-dual gap, the objective function error, the feasibility measure, and the gradient norm of the objective function along the trajectory generated by the system. When the Tikhonov regularization parameter tends slowly to zero, we prove that the primal trajectory of the Tikhonov regularized dynamical system converges strongly to the minimal norm solution of the linear equality constrained convex optimization problem. Numerical experiments are performed to illustrate the efficiency of our approach. △ Less

Submitted 21 April, 2024; v1 submitted 7 July, 2023; originally announced July 2023.