Showing 1–19 of 19 results for author: Briceno-Arias, L M

Forward-backward algorithm for functions with locally Lipschitz gradient: applications to mean field games

Authors: Luis M. Briceno-Arias, Francisco José Silva, Xian** Yang

Abstract: In this paper, we provide a generalization of the forward-backward splitting algorithm for minimizing the sum of a proper convex lower semicontinuous function and a differentiable convex function whose gradient satisfies a locally Lipschitztype condition. We prove the convergence of our method and derive a linear convergence rate when the differentiable function is locally strongly convex. We reco… ▽ More In this paper, we provide a generalization of the forward-backward splitting algorithm for minimizing the sum of a proper convex lower semicontinuous function and a differentiable convex function whose gradient satisfies a locally Lipschitztype condition. We prove the convergence of our method and derive a linear convergence rate when the differentiable function is locally strongly convex. We recover classical results in the case when the gradient of the differentiable function is globally Lipschitz continuous and an already known linear convergence rate when the function is globally strongly convex. We apply the algorithm to approximate equilibria of variational mean field game systems with local couplings. Compared with some benchmark algorithms to solve these problems, our numerical tests show similar performances in terms of the number of iterations but an important gain in the required computational time. △ Less

Submitted 28 June, 2023; originally announced June 2023.

Enhanced computation of the proximity operator for perspective functions

Authors: Luis M. Briceño-Arias, Cristóbal Vivar-Vargas

Abstract: In this paper we provide an explicit expression for the proximity operator of a perspective of any proper lower semicontinuous convex function defined on a Hilbert space. Our computation enhances and generalizes known formulae for the case when the Fenchel conjugate of the convex function has open domain or when it is radial. We provide several examples of non-radial functions for which the domain… ▽ More In this paper we provide an explicit expression for the proximity operator of a perspective of any proper lower semicontinuous convex function defined on a Hilbert space. Our computation enhances and generalizes known formulae for the case when the Fenchel conjugate of the convex function has open domain or when it is radial. We provide several examples of non-radial functions for which the domain of its conjugate is not open and we compute the proximity operators of their perspectives. △ Less

Submitted 8 May, 2023; originally announced May 2023.

MSC Class: 46N10; 47J20; 49J53; 49N15; 90C25

Proximity Operators of Perspective Functions with Nonlinear Scaling

Authors: Luis M. Briceño-Arias, Patrick L. Combettes, Francisco J. Silva

Abstract: A perspective function is a construction which combines a base function defined on a given space with a nonlinear scaling function defined on another space and which yields a lower semicontinuous convex function on the product space. Since perspective functions are typically nonsmooth, their use in first-order algorithms necessitates the computation of their proximity operator. This paper establis… ▽ More A perspective function is a construction which combines a base function defined on a given space with a nonlinear scaling function defined on another space and which yields a lower semicontinuous convex function on the product space. Since perspective functions are typically nonsmooth, their use in first-order algorithms necessitates the computation of their proximity operator. This paper establishes closed-form expressions for the proximity operator of a perspective function defined on a Hilbert space in terms of a proximity operator involving its base function and one involving its scaling function. △ Less

Submitted 4 July, 2024; v1 submitted 9 March, 2023; originally announced March 2023.

Perspective Functions with Nonlinear Scaling

Authors: Luis M. Briceño-Arias, Patrick L. Combettes, Francisco J. Silva

Abstract: The classical perspective of a function is a construction which transforms a convex function into one that is jointly convex with respect to an auxiliary scaling variable. Motivated by applications in several areas of applied analysis, we investigate an extension of this construct in which the scaling variable is replaced by a nonlinear term. Our construction is placed in the general context of lo… ▽ More The classical perspective of a function is a construction which transforms a convex function into one that is jointly convex with respect to an auxiliary scaling variable. Motivated by applications in several areas of applied analysis, we investigate an extension of this construct in which the scaling variable is replaced by a nonlinear term. Our construction is placed in the general context of locally convex spaces and it generates a lower semicontinuous convex function under broad assumptions on the underlying functions. Various convex-analytical properties are established and closed-form expressions are derived. Several applications are presented. △ Less

Submitted 17 October, 2023; v1 submitted 30 October, 2022; originally announced October 2022.

A Perturbation Framework for Convex Minimization and Monotone Inclusion Problems with Nonlinear Compositions

Authors: Luis M. Briceño-Arias, Patrick L. Combettes

Abstract: We introduce a framework based on Rockafellar's perturbation theory to analyze and solve general nonsmooth convex minimization and monotone inclusion problems involving nonlinearly composed functions as well as linear compositions. Such problems have been investigated only from a primal perspective and only for nonlinear compositions of smooth functions in finite-dimensional spaces in the absence… ▽ More We introduce a framework based on Rockafellar's perturbation theory to analyze and solve general nonsmooth convex minimization and monotone inclusion problems involving nonlinearly composed functions as well as linear compositions. Such problems have been investigated only from a primal perspective and only for nonlinear compositions of smooth functions in finite-dimensional spaces in the absence of linear compositions. In the context of Banach spaces, the proposed perturbation analysis serves as a foundation for the construction of a dual problem and of a maximally monotone Kuhn--Tucker operator which is decomposable as the sum of simpler monotone operators. In the Hilbertian setting, this decomposition leads to a block-iterative primal-dual algorithm that fully splits all the components of the problem and appears to be the first proximal splitting algorithm for handling nonlinear composite problems. Various applications are discussed. △ Less

Submitted 22 June, 2023; v1 submitted 22 November, 2021; originally announced November 2021.

Resolvent splitting with minimal lifting for composite monotone inclusions

Authors: Luis M. Briceño-Arias

Abstract: In this paper we propose a resolvent splitting with minimal lifting for finding a zero of the sum of $n\ge 2$ maximally monotone operators involving the composition with a linear bounded operator. The resolvent of each monotone operator, the linear operator, and its adjoint are computed exactly once in the proposed algorithm. In the case when the linear operator is the identity, we recover the res… ▽ More In this paper we propose a resolvent splitting with minimal lifting for finding a zero of the sum of $n\ge 2$ maximally monotone operators involving the composition with a linear bounded operator. The resolvent of each monotone operator, the linear operator, and its adjoint are computed exactly once in the proposed algorithm. In the case when the linear operator is the identity, we recover the resolvent splitting with minimal lifting developed in Malitsky-Tam (2021). We also derive a new resolvent splitting for solving the composite monotone inclusion in the case $n=2$ with minimal $1-$fold lifting. △ Less

Submitted 27 July, 2022; v1 submitted 18 November, 2021; originally announced November 2021.

Comments: There is a mistake in the main Theorem. Even if the derived algorithm is convergent, we cannot ensure its convergence to a solution to the main problem. We are now trying to fix this. The author thanks F. Aragón-Artacho for noting and communicating this issue

Forward-partial inverse-half-forward splitting algorithm for solving monotone inclusions

Authors: Luis M. Briceño-Arias, **jian Chen, Fernando Roldán, Yuchao Tang

Abstract: In this paper we provide a splitting algorithm for solving coupled monotone inclusions in a real Hilbert space involving the sum of a normal cone to a vector subspace, a maximally monotone, a monotone-Lipschitzian, and a cocoercive operator. The proposed method takes advantage of the intrinsic properties of each operator and generalizes the method of partial inverses and the forward-backward-half… ▽ More In this paper we provide a splitting algorithm for solving coupled monotone inclusions in a real Hilbert space involving the sum of a normal cone to a vector subspace, a maximally monotone, a monotone-Lipschitzian, and a cocoercive operator. The proposed method takes advantage of the intrinsic properties of each operator and generalizes the method of partial inverses and the forward-backward-half forward splitting, among other methods. At each iteration, our algorithm needs two computations of the Lipschitzian operator while the cocoercive operator is activated only once. By using product space techniques, we derive a method for solving a composite monotone primal-dual inclusions including linear operators and we apply it to solve constrained composite convex optimization problems. Finally, we apply our algorithm to a constrained total variation least-squares problem and we compare its performance with efficient methods in the literature. △ Less

Submitted 7 February, 2022; v1 submitted 3 April, 2021; originally announced April 2021.

Comments: 16 pages, 1 figure

MSC Class: 47H05; 47H10; 65K05; 65K15; 90C25; 49M29

Split-Douglas-Rachford algorithm for composite monotone inclusions and Split-ADMM

Authors: Luis M. Briceño-Arias, Fernando Roldán

Abstract: In this paper we provide a generalization of the Douglas-Rachford splitting (DRS) and the primal-dual algorithm (Vu 2013, Condat 2013) for solving monotone inclusions in a real Hilbert space involving a general linear operator. The proposed method allows for primal and dual non-standard metrics and activates the linear operator separately from the monotone operators appearing in the inclusion. In… ▽ More In this paper we provide a generalization of the Douglas-Rachford splitting (DRS) and the primal-dual algorithm (Vu 2013, Condat 2013) for solving monotone inclusions in a real Hilbert space involving a general linear operator. The proposed method allows for primal and dual non-standard metrics and activates the linear operator separately from the monotone operators appearing in the inclusion. In the simplest case when the linear operator has full range, it reduces to classical DRS. Moreover, the weak convergence of primal-dual sequences to a Kuhn-Tucker point is guaranteed, generalizing the main result in Svaiter (2011). Inspired by Gabay (1983), we also derive a new Split-ADMM (SADMM) by applying our method to the dual of a convex optimization problem involving a linear operator which can be expressed as the composition of two linear operators. The proposed SADMM activates one linear operator implicitly and the other one explicitly, and we recover ADMM when the latter is set as the identity. Connections and comparisons of our theoretical results with respect to the literature are provided for the main algorithm and SADMM. The flexibility and efficiency of both methods is illustrated via a numerical simulations in total variation image restoration and a sparse minimization problem. △ Less

Submitted 21 September, 2021; v1 submitted 27 January, 2021; originally announced January 2021.

Comments: 26 pages

MSC Class: 47H05; 47H10; 65K05; 65K15; 90C25; 49M29 ACM Class: I.4.4

A Random Block-Coordinate Douglas-Rachford Splitting Method with Low Computational Complexity for Binary Logistic Regression

Authors: Luis M. Briceno-Arias, Giovanni Chierchia, Emilie Chouzenoux, Jean-Christophe Pesquet

Abstract: In this paper, we propose a new optimization algorithm for sparse logistic regression based on a stochastic version of the Douglas-Rachford splitting method. Our algorithm sweeps the training set by randomly selecting a mini-batch of data at each iteration, and it allows us to update the variables in a block coordinate manner. Our approach leverages the proximity operator of the logistic loss, whi… ▽ More In this paper, we propose a new optimization algorithm for sparse logistic regression based on a stochastic version of the Douglas-Rachford splitting method. Our algorithm sweeps the training set by randomly selecting a mini-batch of data at each iteration, and it allows us to update the variables in a block coordinate manner. Our approach leverages the proximity operator of the logistic loss, which is expressed with the generalized Lambert W function. Experiments carried out on standard datasets demonstrate the efficiency of our approach w.r.t. stochastic gradient-like methods. △ Less

Submitted 25 December, 2017; originally announced December 2017.

Forward-Backward-Half Forward Algorithm for Solving Monotone Inclusions

Authors: Luis M. Briceño-Arias, Damek Davis

Abstract: Tseng's algorithm finds a zero of the sum of a maximally monotone operator and a monotone continuous operator by evaluating the latter twice per iteration. In this paper, we modify Tseng's algorithm for finding a zero of the sum of three operators, where we add a cocoercive operator to the inclusion. Since the sum of a cocoercive and a monotone-Lipschitz operator is monotone and Lipschitz, we coul… ▽ More Tseng's algorithm finds a zero of the sum of a maximally monotone operator and a monotone continuous operator by evaluating the latter twice per iteration. In this paper, we modify Tseng's algorithm for finding a zero of the sum of three operators, where we add a cocoercive operator to the inclusion. Since the sum of a cocoercive and a monotone-Lipschitz operator is monotone and Lipschitz, we could use Tseng's method for solving this problem, but implementing both operators twice per iteration and without taking into advantage the cocoercivity property of one operator. Instead, in our approach, although the {continuous monotone} operator must still be evaluated twice, we exploit the cocoercivity of one operator by evaluating it only once per iteration. Moreover, when the cocoercive or {continuous-monotone} operators are zero it reduces to Tseng's or forward-backward splittings, respectively, unifying in this way both algorithms. In addition, we provide a {preconditioned} version of the proposed method including non self-adjoint linear operators in the computation of resolvents and the single-valued operators involved. This approach allows us to {also} extend previous variable metric versions of Tseng's and forward-backward methods and simplify their conditions on the underlying metrics. We also exploit the case when non self-adjoint linear operators are triangular by blocks in the primal-dual product space for solving primal-dual composite monotone inclusions, obtaining Gauss-Seidel type algorithms which generalize several primal-dual methods available in the literature. Finally we explore {applications to the obstacle problem, Empirical Risk Minimization, distributed optimization and nonlinear programming and we illustrate the performance of the method via some numerical simulations. △ Less

Submitted 23 March, 2018; v1 submitted 9 March, 2017; originally announced March 2017.

Comments: 34 Pages, Title Change

MSC Class: 47H05; 65K05; 65K15; 90C25

Proximal methods for stationary Mean Field Games with local couplings

Authors: L. M. Briceño-Arias, D. Kalise, F. J. Silva

Abstract: We address the numerical approximation of Mean Field Games with local couplings. For power-like Hamiltonians, we consider both unconstrained and constrained stationary systems with density constraints in order to model hard congestion effects. For finite difference discretizations of the Mean Field Game system, we follow a variational approach. We prove that the aforementioned schemes can be obtai… ▽ More We address the numerical approximation of Mean Field Games with local couplings. For power-like Hamiltonians, we consider both unconstrained and constrained stationary systems with density constraints in order to model hard congestion effects. For finite difference discretizations of the Mean Field Game system, we follow a variational approach. We prove that the aforementioned schemes can be obtained as the optimality system of suitably defined optimization problems. In order to prove the existence of solutions of the scheme with a variational argument, the monotonicity of the coupling term is not used, which allow us to recover general existence results. Next, assuming next that the coupling term is monotone, the variational problem is cast as a convex optimization problem for which we study and compare several proximal type methods. These algorithms have several interesting features, such as global convergence and stability with respect to the viscosity parameter, which can eventually be zero. We assess the performance of the methods via numerical experiments. △ Less

Submitted 6 February, 2019; v1 submitted 27 August, 2016; originally announced August 2016.

Journal ref: SIAM J. Control Optim., 56(2)(2018), 801-836

A Strongly Convergent Primal-Dual Method for Nonoverlap** Domain Decomposition

Authors: Hédy Attouch, Luis M. Briceño-Arias, Patrick L. Combettes

Abstract: We propose a primal-dual parallel proximal splitting method for solving domain decomposition problems for partial differential equations. The problem is formulated via minimization of energy functions on the subdomains with coupling constraints which model various properties of the solution at the interfaces. The proposed method can handle a wide range of linear and nonlinear problems, with flexib… ▽ More We propose a primal-dual parallel proximal splitting method for solving domain decomposition problems for partial differential equations. The problem is formulated via minimization of energy functions on the subdomains with coupling constraints which model various properties of the solution at the interfaces. The proposed method can handle a wide range of linear and nonlinear problems, with flexible, possibly nonlinear, transmission conditions across the interfaces. Strong convergence in the energy spaces is established in this general setting, and without any additional assumption on the energy functions or the geometry of the problem. Several examples are presented. △ Less

Submitted 16 October, 2014; originally announced October 2014.

MSC Class: 65M55; 47N10

Forward--partial inverse--forward splitting for solving monotone inclusions

Authors: Luis M. Briceño-Arias

Abstract: In this paper we provide a splitting method for finding a zero of the sum of a maximally monotone operator, a lipschitzian monotone operator, and a normal cone to a closed vectorial subspace of a real Hilbert space. The problem is characterized by a simpler monotone inclusion involving only two operators: the partial inverse of the maximally monotone operator with respect to the vectorial subspace… ▽ More In this paper we provide a splitting method for finding a zero of the sum of a maximally monotone operator, a lipschitzian monotone operator, and a normal cone to a closed vectorial subspace of a real Hilbert space. The problem is characterized by a simpler monotone inclusion involving only two operators: the partial inverse of the maximally monotone operator with respect to the vectorial subspace and a suitable lipschitzian monotone operator. By applying the Tseng's method in this context we obtain a splitting algorithm that exploits the whole structure of the original problem and generalizes partial inverse and Tseng's methods. Connections with other methods available in the literature and applications to inclusions involving $m$ maximally monotone operators, to primal-dual composite monotone inclusions, and to zero-sum games are provided. △ Less

Submitted 24 June, 2014; originally announced June 2014.

MSC Class: 47H05; 47J25; 65K05; 90C25

Regularization of $\ell_1$ minimization for dealing with outliers and noise in Statistics and Signal Recovery

Authors: Salvador Flores, Luis M. Briceno-Arias

Abstract: We study the robustness properties of $\ell_1$ norm minimization for the classical linear regression problem with a given design matrix and contamination restricted to the dependent variable. We perform a fine error analysis of the $\ell_1$ estimator for measurements errors consisting of outliers coupled with noise. We introduce a new estimation technique resulting from a regularization of… ▽ More We study the robustness properties of $\ell_1$ norm minimization for the classical linear regression problem with a given design matrix and contamination restricted to the dependent variable. We perform a fine error analysis of the $\ell_1$ estimator for measurements errors consisting of outliers coupled with noise. We introduce a new estimation technique resulting from a regularization of $\ell_1$ minimization by inf-convolution with the $\ell_2$ norm. Concerning robustness to large outliers, the proposed estimator keeps the breakdown point of the $\ell_1$ estimator, and reduces to least squares when there are not outliers. We present a globally convergent forward-backward algorithm for computing our estimator and some numerical experiments confirming its theoretical properties. △ Less

Submitted 25 February, 2014; v1 submitted 28 October, 2013; originally announced October 2013.

MSC Class: 90C31; 62F35; 65K05; 94B35

Forward-Douglas-Rachford splitting and forward-partial inverse method for solving monotone inclusions

Authors: Luis M. Briceño-Arias

Abstract: We provide two weakly convergent algorithms for finding a zero of the sum of a maximally monotone operator, a cocoercive operator, and the normal cone to a closed vector subspace of a real Hilbert space. The methods exploit the intrinsic structure of the problem by activating explicitly the cocoercive operator in the first step, and taking advantage of a vector space decomposition in the second st… ▽ More We provide two weakly convergent algorithms for finding a zero of the sum of a maximally monotone operator, a cocoercive operator, and the normal cone to a closed vector subspace of a real Hilbert space. The methods exploit the intrinsic structure of the problem by activating explicitly the cocoercive operator in the first step, and taking advantage of a vector space decomposition in the second step. The second step of the first method is a Douglas-Rachford iteration involving the maximally monotone operator and the normal cone. In the second method it is a proximal step involving the partial inverse of the maximally monotone operator with respect to the vector subspace. Connections between the proposed methods and other methods in the literature are provided. Applications to monotone inclusions with finitely many maximally monotone operators and optimization problems are examined. △ Less

Submitted 24 December, 2012; originally announced December 2012.

MSC Class: 47H05; 65K10; 47J25; 90C25

A Douglas-Rachford Splitting Method for Solving Equilibrium Problems

Authors: Luis M. Briceño-Arias

Abstract: We propose a splitting method for solving an equilibrium problem involving the sum of two bifunctions satisfying standard conditions. We prove that this problem is equivalent to find a zero of two appropriate maximally monotone operators. Our algorithm is a consequence of the Douglas--Rachford splitting applied to this auxiliary monotone inclusion. Connections between monotone inclusions and equil… ▽ More We propose a splitting method for solving an equilibrium problem involving the sum of two bifunctions satisfying standard conditions. We prove that this problem is equivalent to find a zero of two appropriate maximally monotone operators. Our algorithm is a consequence of the Douglas--Rachford splitting applied to this auxiliary monotone inclusion. Connections between monotone inclusions and equilibrium problems are studied. △ Less

Submitted 27 June, 2012; v1 submitted 7 October, 2011; originally announced October 2011.

Comments: 12 pages

MSC Class: Primary: 90B74; 90C30. Secondary: 47J20; 47J22

Monotone Operator Methods for Nash Equilibria in Non-Potential Games

Authors: Luis M. Briceno-Arias, Patrick L. Combettes

Abstract: We observe that a significant class of Nash equilibrium problems in non-potential games can be associated with monotone inclusion problems. We propose splitting techniques to solve such problems and establish their convergence. Applications to generalized Nash equilibria, zero-sum games, and cyclic proximity problems are demonstrated. We observe that a significant class of Nash equilibrium problems in non-potential games can be associated with monotone inclusion problems. We propose splitting techniques to solve such problems and establish their convergence. Applications to generalized Nash equilibria, zero-sum games, and cyclic proximity problems are demonstrated. △ Less

Submitted 1 June, 2011; originally announced June 2011.

Outer approximation method for constrained composite fixed point problems involving Lipschitz pseudo contractive operators

Authors: Luis M. Briceño-Arias

Abstract: We propose a method for solving constrained fixed point problems involving compositions of Lipschitz pseudo contractive and firmly nonexpansive operators in Hilbert spaces. Each iteration of the method uses separate evaluations of these operators and an outer approximation given by the projection onto a closed half-space containing the constraint set. Its convergence is established and application… ▽ More We propose a method for solving constrained fixed point problems involving compositions of Lipschitz pseudo contractive and firmly nonexpansive operators in Hilbert spaces. Each iteration of the method uses separate evaluations of these operators and an outer approximation given by the projection onto a closed half-space containing the constraint set. Its convergence is established and applications to monotone inclusion splitting and constrained equilibrium problems are demonstrated. △ Less

Submitted 7 January, 2011; originally announced January 2011.

MSC Class: Primary 65K05; Secondary 47H05; 47H10; 47J05; 65K15; 90C25

A parallel splitting method for weakly coupled monotone inclusions

Authors: H. Attouch, L. M. Briceno-Arias, P. L. Combettes

Abstract: A parallel splitting method is proposed for solving systems of coupled monotone inclusions in Hilbert spaces. Convergence is established for a wide class of coupling schemes. Unlike classical alternating algorithms, which are limited to two variables and linear coupling, our parallel method can handle an arbitrary number of variables as well as nonlinear coupling schemes. The breadth and flexibi… ▽ More A parallel splitting method is proposed for solving systems of coupled monotone inclusions in Hilbert spaces. Convergence is established for a wide class of coupling schemes. Unlike classical alternating algorithms, which are limited to two variables and linear coupling, our parallel method can handle an arbitrary number of variables as well as nonlinear coupling schemes. The breadth and flexibility of the proposed framework is illustrated through applications in the areas of evolution inclusions, dynamical games, signal recovery, image decomposition, best approximation, network flows, and variational problems in Sobolev spaces. △ Less

Submitted 25 February, 2009; originally announced February 2009.

MSC Class: 49M27; 90C25