Showing 1–17 of 17 results for author: Bui, N

Coverage-Validity-Aware Algorithmic Recourse

Authors: Ngoc Bui, Duy Nguyen, Man-Chung Yue, Viet Anh Nguyen

Abstract: Algorithmic recourse emerges as a prominent technique to promote the explainability, transparency and hence ethics of machine learning models. Existing algorithmic recourse approaches often assume an invariant predictive model; however, the predictive model is usually updated upon the arrival of new data. Thus, a recourse that is valid respective to the present model may become invalid for the fut… ▽ More Algorithmic recourse emerges as a prominent technique to promote the explainability, transparency and hence ethics of machine learning models. Existing algorithmic recourse approaches often assume an invariant predictive model; however, the predictive model is usually updated upon the arrival of new data. Thus, a recourse that is valid respective to the present model may become invalid for the future model. To resolve this issue, we propose a novel framework to generate a model-agnostic recourse that exhibits robustness to model shifts. Our framework first builds a coverage-validity-aware linear surrogate of the nonlinear (black-box) model; then, the recourse is generated with respect to the linear surrogate. We establish a theoretical connection between our coverage-validity-aware linear surrogate and the minimax probability machines (MPM). We then prove that by prescribing different covariance robustness, the proposed framework recovers popular regularizations for MPM, including the $\ell_2$-regularization and class-reweighting. Furthermore, we show that our surrogate pushes the approximate hyperplane intuitively, facilitating not only robust but also interpretable recourses. The numerical results demonstrate the usefulness and robustness of our framework. △ Less

Submitted 19 November, 2023; originally announced November 2023.

Integral Resolvent and Proximal Mixtures

Authors: Minh N. Bùi, Patrick L. Combettes

Abstract: Using the theory of Hilbert direct integrals, we introduce and study a monotonicity-preserving operation, termed the integral resolvent mixture. It combines arbitrary families of monotone operators acting on different spaces and linear operators. As a special case, we investigate the resolvent expectation, an operation which combines monotone operators in such a way that the resulting resolvent is… ▽ More Using the theory of Hilbert direct integrals, we introduce and study a monotonicity-preserving operation, termed the integral resolvent mixture. It combines arbitrary families of monotone operators acting on different spaces and linear operators. As a special case, we investigate the resolvent expectation, an operation which combines monotone operators in such a way that the resulting resolvent is the Lebesgue expectation of the individual resolvents. Along the same lines, we introduce an operation that mixes arbitrary families of convex functions defined on different spaces and linear operators to create a composite convex function. Such constructs have so far been limited to finite families of operators and functions. The subdifferential of the integral proximal mixture is shown to be the integral resolvent mixture of the individual subdifferentials. Applications to the relaxation of systems of composite monotone inclusions are presented. △ Less

Submitted 20 May, 2024; v1 submitted 8 November, 2023; originally announced November 2023.

Comments: arXiv admin note: text overlap with arXiv:2311.04117

Hilbert Direct Integrals of Monotone Operators

Authors: Minh N. Bùi, Patrick L. Combettes

Abstract: Finite Cartesian products of operators play a central role in monotone operator theory and its applications. Extending such products to arbitrary families of operators acting on different Hilbert spaces is an open problem, which we address by introducing the Hilbert direct integral of a family of monotone operators. The properties of this construct are studied and conditions under which the direct… ▽ More Finite Cartesian products of operators play a central role in monotone operator theory and its applications. Extending such products to arbitrary families of operators acting on different Hilbert spaces is an open problem, which we address by introducing the Hilbert direct integral of a family of monotone operators. The properties of this construct are studied and conditions under which the direct integral inherits the properties of the factor operators are provided. The question of determining whether the Hilbert direct integral of a family of subdifferentials of convex functions is itself a subdifferential leads us to introducing the Hilbert direct integral of a family of functions. We establish explicit expressions for evaluating the Legendre conjugate, subdifferential, recession function, Moreau envelope, and proximity operator of such integrals. Next, we propose a duality framework for monotone inclusion problems involving integrals of linearly composed monotone operators and show its pertinence towards the development of numerical solution methods. Applications to inclusion and variational problems are discussed. △ Less

Submitted 15 May, 2024; v1 submitted 7 November, 2023; originally announced November 2023.

MSC Class: 49J53; 46G10; 58E30

Interchange Rules for Integral Functions

Authors: Minh N. Bùi, Patrick L. Combettes

Abstract: We first present an abstract principle for the interchange of infimization and integration over spaces of map**s taking values in topological spaces. New conditions on the underlying space and the integrand are then introduced to convert this principle into concrete scenarios that are shown to capture those of various existing interchange rules. These results are leveraged to improve state-of-th… ▽ More We first present an abstract principle for the interchange of infimization and integration over spaces of map**s taking values in topological spaces. New conditions on the underlying space and the integrand are then introduced to convert this principle into concrete scenarios that are shown to capture those of various existing interchange rules. These results are leveraged to improve state-of-the-art interchange rules for evaluating Legendre conjugates, subdifferentials, recessions, Moreau envelopes, and proximity operators of integral functions by bringing the corresponding operations under the integral sign. △ Less

Submitted 8 May, 2023; originally announced May 2023.

Analysis and Numerical Solution of a Modular Convex Nash Equilibrium Problem

Authors: Minh N. Bùi, Patrick L. Combettes

Abstract: We investigate a modular convex Nash equilibrium problem involving nonsmooth functions acting on linear mixtures of strategies, as well as smooth coupling functions. An asynchronous block-iterative decomposition method is proposed to solve it. We investigate a modular convex Nash equilibrium problem involving nonsmooth functions acting on linear mixtures of strategies, as well as smooth coupling functions. An asynchronous block-iterative decomposition method is proposed to solve it. △ Less

Submitted 2 November, 2021; originally announced November 2021.

Comments: arXiv admin note: substantial text overlap with arXiv:2101.00532

A Decomposition Method for Solving Multicommodity Network Equilibrium

Authors: Minh N. Bùi

Abstract: We consider the numerical aspect of the multicommodity network equilibrium problem proposed by Rockafellar in 1995. Our method relies on the flexible monotone operator splitting framework recently proposed by Combettes and Eckstein. We consider the numerical aspect of the multicommodity network equilibrium problem proposed by Rockafellar in 1995. Our method relies on the flexible monotone operator splitting framework recently proposed by Combettes and Eckstein. △ Less

Submitted 6 August, 2021; originally announced August 2021.

Projective Splitting as a Warped Proximal Algorithm

Authors: Minh N. Bùi

Abstract: We show that the asynchronous block-iterative primal-dual projective splitting framework introduced by P. L. Combettes and J. Eckstein in their 2018 Math. Program. paper can be viewed as an instantiation of the recently proposed warped proximal algorithm. We show that the asynchronous block-iterative primal-dual projective splitting framework introduced by P. L. Combettes and J. Eckstein in their 2018 Math. Program. paper can be viewed as an instantiation of the recently proposed warped proximal algorithm. △ Less

Submitted 4 June, 2021; originally announced June 2021.

Block-Activated Algorithms for Multicomponent Fully Nonsmooth Minimization

Authors: Minh N. Bùi, Patrick L. Combettes, Zev C. Woodstock

Abstract: Under consideration are multicomponent minimization problems involving a separable nonsmooth convex function penalizing the components individually, and nonsmooth convex coupling terms penalizing linear mixtures of the components. We investigate block-activated proximal algorithms for solving such problems, i.e., algorithms which, at each iteration, need to use only a block of the underlying funct… ▽ More Under consideration are multicomponent minimization problems involving a separable nonsmooth convex function penalizing the components individually, and nonsmooth convex coupling terms penalizing linear mixtures of the components. We investigate block-activated proximal algorithms for solving such problems, i.e., algorithms which, at each iteration, need to use only a block of the underlying functions, as opposed to all of them as in standard methods. For smooth coupling functions, several block-activated algorithms exist and they are well understood. By contrast, in the fully nonsmooth case, few block-activated methods are available and little effort has been devoted to assessing them. Our goal is to shed more light on the implementation, the features, and the behavior of these algorithms, compare their merits, and provide machine learning and image recovery experiments illustrating their performance. △ Less

Submitted 25 August, 2021; v1 submitted 28 February, 2021; originally announced March 2021.

A Warped Resolvent Algorithm to Construct Nash Equilibria

Authors: Minh N. Bùi, Patrick L. Combettes

Abstract: We propose an asynchronous block-iterative decomposition algorithm to solve Nash equilibrium problems involving a mix of nonsmooth and smooth functions acting on linear mixtures of strategies. The methodology relies heavily on monotone operator theory and in particular on warped resolvents. We propose an asynchronous block-iterative decomposition algorithm to solve Nash equilibrium problems involving a mix of nonsmooth and smooth functions acting on linear mixtures of strategies. The methodology relies heavily on monotone operator theory and in particular on warped resolvents. △ Less

Submitted 2 January, 2021; originally announced January 2021.

Multivariate Monotone Inclusions in Saddle Form

Authors: Minh N. Bùi, Patrick L. Combettes

Abstract: We propose a novel approach to monotone operator splitting based on the notion of a saddle operator. Under investigation is a highly structured multivariate monotone inclusion problem involving a mix of set-valued, cocoercive, and Lipschitzian monotone operators, as well as various monotonicity-preserving operations among them. This model encompasses most formulations found in the literature. A li… ▽ More We propose a novel approach to monotone operator splitting based on the notion of a saddle operator. Under investigation is a highly structured multivariate monotone inclusion problem involving a mix of set-valued, cocoercive, and Lipschitzian monotone operators, as well as various monotonicity-preserving operations among them. This model encompasses most formulations found in the literature. A limitation of existing primal-dual algorithms is that they operate in a product space that is too small to achieve full splitting of our problem in the sense that each operator is used individually. To circumvent this difficulty, we recast the problem as that of finding a zero of a saddle operator that acts on a bigger space. This leads to an algorithm of unprecedented flexibility, which achieves full splitting, exploits the specific attributes of each operator, is asynchronous, and requires to activate only blocks of operators at each iteration, as opposed to activating all of them. The latter feature is of critical importance in large-scale problems. Weak convergence of the main algorithm is established, as well as the strong convergence of a variant. Various applications are discussed, and instantiations of the proposed framework in the context of variational inequalities and minimization problems are presented. △ Less

Submitted 11 March, 2021; v1 submitted 14 February, 2020; originally announced February 2020.

MSC Class: 47H05; 49M27; 47J20; 65K05; 90C25

The Douglas--Rachford Algorithm Converges Only Weakly

Authors: Minh N. Bùi, Patrick L. Combettes

Abstract: We show that the weak convergence of the Douglas--Rachford algorithm for finding a zero of the sum of two maximally monotone operators cannot be improved to strong convergence. Likewise, we show that strong convergence can fail for the method of partial inverses. We show that the weak convergence of the Douglas--Rachford algorithm for finding a zero of the sum of two maximally monotone operators cannot be improved to strong convergence. Likewise, we show that strong convergence can fail for the method of partial inverses. △ Less

Submitted 19 December, 2019; originally announced December 2019.

Warped Proximal Iterations for Monotone Inclusions

Authors: Minh N. Bùi, Patrick L. Combettes

Abstract: Resolvents of set-valued operators play a central role in various branches of mathematics and in particular in the design and the analysis of splitting algorithms for solving monotone inclusions. We propose a generalization of this notion, called warped resolvent, which is constructed with the help of an auxiliary operator. The properties of warped resolvents are investigated and connections are m… ▽ More Resolvents of set-valued operators play a central role in various branches of mathematics and in particular in the design and the analysis of splitting algorithms for solving monotone inclusions. We propose a generalization of this notion, called warped resolvent, which is constructed with the help of an auxiliary operator. The properties of warped resolvents are investigated and connections are made with existing notions. Abstract weak and strong convergence principles based on warped resolvents are proposed and shown to not only provide a synthetic view of splitting algorithms but to also constitute an effective device to produce new solution methods for challenging inclusion problems. △ Less

Submitted 22 June, 2020; v1 submitted 19 August, 2019; originally announced August 2019.

Bregman Forward-Backward Operator Splitting

Authors: Minh N. Bùi, Patrick L. Combettes

Abstract: We establish the convergence of the forward-backward splitting algorithm based on Bregman distances for the sum of two monotone operators in reflexive Banach spaces. Even in Euclidean spaces, the convergence of this algorithm has so far been proved only in the case of minimization problems. The proposed framework features Bregman distances that vary over the iterations and a novel assumption on th… ▽ More We establish the convergence of the forward-backward splitting algorithm based on Bregman distances for the sum of two monotone operators in reflexive Banach spaces. Even in Euclidean spaces, the convergence of this algorithm has so far been proved only in the case of minimization problems. The proposed framework features Bregman distances that vary over the iterations and a novel assumption on the single-valued operator that captures various properties scattered in the literature. In the minimization setting, we obtain rates that are sharper than existing ones. △ Less

Submitted 27 September, 2020; v1 submitted 11 August, 2019; originally announced August 2019.

Invariants of the bi-Lipschitz contact equivalence of continuous definable function germs

Authors: Tien-Son Pham, Nguyen Thao Nguyen Bui

Abstract: We construct an invariant of the bi-Lipschitz contact equivalence of continuous function germs definable in a polynomially bounded o-minimal structure, such as semialgebraic functions. For a germ $f,$ the invariant is given in terms of the leading coefficients of the asymptotic expansions of $f$ along the connected components of the tangency variety of $f.$ We construct an invariant of the bi-Lipschitz contact equivalence of continuous function germs definable in a polynomially bounded o-minimal structure, such as semialgebraic functions. For a germ $f,$ the invariant is given in terms of the leading coefficients of the asymptotic expansions of $f$ along the connected components of the tangency variety of $f.$ △ Less

Submitted 14 January, 2019; originally announced January 2019.

Comments: arXiv admin note: text overlap with arXiv:1901.01698

MSC Class: 14P15; 32S05; 03C64

Applying FISTA to optimization problems (with or) without minimizers

Authors: Heinz H. Bauschke, Minh N. Bui, Xianfu Wang

Abstract: Beck and Teboulle's FISTA method for finding a minimizer of the sum of two convex functions, one of which has a Lipschitz continuous gradient whereas the other may be nonsmooth, is arguably the most important optimization algorithm of the past decade. While research activity on FISTA has exploded ever since, the mathematically challenging case when the original optimization problem has no minimize… ▽ More Beck and Teboulle's FISTA method for finding a minimizer of the sum of two convex functions, one of which has a Lipschitz continuous gradient whereas the other may be nonsmooth, is arguably the most important optimization algorithm of the past decade. While research activity on FISTA has exploded ever since, the mathematically challenging case when the original optimization problem has no minimizer has found only limited attention. In this work, we systematically study FISTA and its variants. We present general results that are applicable, regardless of the existence of minimizers. △ Less

Submitted 3 July, 2019; v1 submitted 22 November, 2018; originally announced November 2018.

MSC Class: 90C25; 65K05 (Primary); 49M27 (Secondary)

On sums and convex combinations of projectors onto convex sets

Authors: Heinz H. Bauschke, Minh N. Bui, Xianfu Wang

Abstract: The projector onto the Minkowski sum of closed convex sets is generally not equal to the sum of individual projectors. In this work, we provide a complete answer to the question of characterizing the instances where such an equality holds. Our results unify and extend the case of linear subspaces and Zarantonello's results for projectors onto cones. A detailed analysis in the case of convex combin… ▽ More The projector onto the Minkowski sum of closed convex sets is generally not equal to the sum of individual projectors. In this work, we provide a complete answer to the question of characterizing the instances where such an equality holds. Our results unify and extend the case of linear subspaces and Zarantonello's results for projectors onto cones. A detailed analysis in the case of convex combinations is also carried out. We establish the partial sum property for projectors onto convex cones, and we also present various examples as well as a detailed analysis in the univariate case. △ Less

Submitted 14 September, 2018; v1 submitted 6 February, 2018; originally announced February 2018.

Comments: 1 figure

MSC Class: 47H05; 47H09; 47L07 (Primary); 46A32; 52A05; 52A41; 90C25 (Secondary)

Projecting onto the intersection of a cone and a sphere

Authors: Heinz H. Bauschke, Minh N. Bui, Xianfu Wang

Abstract: The projection onto the intersection of sets generally does not allow for a closed form even when the individual projection operators have explicit descriptions. In this work, we systematically analyze the projection onto the intersection of a cone with either a ball or a sphere. Several cases are provided where the projector is available in closed form. Various examples based on finitely generate… ▽ More The projection onto the intersection of sets generally does not allow for a closed form even when the individual projection operators have explicit descriptions. In this work, we systematically analyze the projection onto the intersection of a cone with either a ball or a sphere. Several cases are provided where the projector is available in closed form. Various examples based on finitely generated cones, the Lorentz cone, and the the cone of positive semidefinite matrices are presented. The usefulness of our formulae is illustrated by numerical experiments for determining copositivity of real symmetric matrices. △ Less

Submitted 12 April, 2018; v1 submitted 1 August, 2017; originally announced August 2017.

Comments: 1 figure