-
Coderivative-Based Newton Methods with Wolfe Linesearch for Nonsmooth Optimization
Authors:
Miantao Chao,
Boris S. Mordukhovich,
Zijian Shi,
** Zhang
Abstract:
This paper introduces and develops novel coderivative-based Newton methods with Wolfe linesearch conditions to solve various classes of problems in nonsmooth optimization. We first propose a generalized regularized Newton method with Wolfe linesearch (GRNM-W) for unconstrained $C^{1,1}$ minimization problems (which are second-order nonsmooth) and establish global as well as local superlinear conve…
▽ More
This paper introduces and develops novel coderivative-based Newton methods with Wolfe linesearch conditions to solve various classes of problems in nonsmooth optimization. We first propose a generalized regularized Newton method with Wolfe linesearch (GRNM-W) for unconstrained $C^{1,1}$ minimization problems (which are second-order nonsmooth) and establish global as well as local superlinear convergence of their iterates. To deal with convex composite minimization problems (which are first-order nonsmooth and can be constrained), we combine the proposed GRNM-W with two algorithmic frameworks: the forward-backward envelope and the augmented Lagrangian method resulting in the two new algorithms called CNFB and CNAL, respectively. Finally, we present numerical results to solve Lasso and support vector machine problems appearing in, e.g., machine learning and statistics, which demonstrate the efficiency of the proposed algorithms.
△ Less
Submitted 3 July, 2024; v1 submitted 2 July, 2024;
originally announced July 2024.
-
Convergence of Descent Methods under Kurdyka-Łojasiewicz Properties
Authors:
G. C. Bento,
B. S. Mordukhovich,
T. S. Mota,
Yu. Nesterov
Abstract:
This paper develops the novel convergence analysis of a generic class of descent methods in nonsmooth and nonconvex optimization under several versions of the Kurdyka-Łojasiewicz (KL) property. Along other results, we prove the finite termination of generic algorithms under the KL property with lower exponents. Specifications are given to convergence rates of some particular algorithms including i…
▽ More
This paper develops the novel convergence analysis of a generic class of descent methods in nonsmooth and nonconvex optimization under several versions of the Kurdyka-Łojasiewicz (KL) property. Along other results, we prove the finite termination of generic algorithms under the KL property with lower exponents. Specifications are given to convergence rates of some particular algorithms including inexact reduced gradient methods and the boosted algorithm in DC programming. It revealed, e.g., that the lower exponent KL property in the DC framework is incompatible with the gradient Lipschitz continuity for the plus function around a local minimizer. On the other hand, we show that the above inconsistency observation may fail if the Lipschitz continuity is replaced by merely the gradient continuity.
△ Less
Submitted 30 June, 2024;
originally announced July 2024.
-
Regular Subgradients of Marginal Functions with Applications to Calculus and Bilevel Programming
Authors:
Le Phuoc Hai,
Felipe Lara,
Boris S. Mordukhovich
Abstract:
The paper addresses the study and applications of a broad class of extended-real-valued functions, known as optimal value or marginal functions, which are frequently appeared in variational analysis, parametric optimization, and a variety of applications. Functions of this type are intrinsically nonsmooth and require the usage of tools of generalized differentiation. The main results of this paper…
▽ More
The paper addresses the study and applications of a broad class of extended-real-valued functions, known as optimal value or marginal functions, which are frequently appeared in variational analysis, parametric optimization, and a variety of applications. Functions of this type are intrinsically nonsmooth and require the usage of tools of generalized differentiation. The main results of this paper provide novel evaluations and exact calculations of regular/Fréchet subgradients and their singular counterparts for general classes of marginal functions via their given data. The obtained results are applied to establishing new calculus rules for such subgradients and necessary optimality conditions in bilevel programming
△ Less
Submitted 31 May, 2024;
originally announced May 2024.
-
Optimal control of perturbed swee** processes with applications to general robotics models
Authors:
Giovanni Colombo,
Boris S. Mordukhovich,
Dao Nguyen,
Trang Nguyen,
Norma Ortiz-Robinson
Abstract:
This paper primarily focuses on the practical applications of optimal control theory for perturbed swee** processes within the realm of robotics dynamics. By describing these models as controlled swee** processes with pointwise control and state constraints and by employing necessary optimality conditions for such systems, we formulate optimal control problems suitable to these models and deve…
▽ More
This paper primarily focuses on the practical applications of optimal control theory for perturbed swee** processes within the realm of robotics dynamics. By describing these models as controlled swee** processes with pointwise control and state constraints and by employing necessary optimality conditions for such systems, we formulate optimal control problems suitable to these models and develop numerical algorithms for their solving. Subsequently, we use the Python Dynamic Optimization library GEKKO to simulate solutions to the posed robotics problems in the case of any fixed number of robots under different initial conditions.
△ Less
Submitted 14 May, 2024;
originally announced May 2024.
-
Relationships between Global and Local Monotonicity of Operators
Authors:
Pham Duy Khanh,
Vu Vinh Huy Khoa,
Juan Enrique Martínez-Legaz,
Boris S. Mordukhovich
Abstract:
The paper is devoted to establishing relationships between global and local monotonicity, as well as their maximality versions, for single-valued and set-valued map**s between finite-dimensional and infinite-dimensional spaces. We first show that for single-valued operators with convex domains in locally convex topological spaces, their continuity ensures that their global monotonicity agrees wi…
▽ More
The paper is devoted to establishing relationships between global and local monotonicity, as well as their maximality versions, for single-valued and set-valued map**s between finite-dimensional and infinite-dimensional spaces. We first show that for single-valued operators with convex domains in locally convex topological spaces, their continuity ensures that their global monotonicity agrees with the local one around any point of the graph. This also holds for set-valued map**s defined on the real line under a certain connectedness condition. The situation is different for set-valued operators in multidimensional spaces as demonstrated by an example of locally monotone operator on the plane that is not globally monotone. Finally, we invoke coderivative criteria from variational analysis to characterize both global and local maximal monotonicity of set-valued operators in Hilbert spaces to verify the equivalence between these monotonicity properties under the closed-graph and global hypomonotonicity assumptions.
△ Less
Submitted 29 March, 2024;
originally announced March 2024.
-
A Refined Proximal Algorithm for Nonconvex Multiobjective Optimization in Hilbert Spaces
Authors:
G. C. Bento,
J. X. Cruz Neto,
J. O. Lopes,
B. S. Mordukhovich,
P. R. Silva Filho
Abstract:
This paper is devoted to general nonconvex problems of multiobjective optimization in Hilbert spaces. Based on Mordukhovich's limiting subgradients, we define a new notion of Pareto critical points for such problems, establish necessary optimality conditions for them, and then employ these conditions to develop a refined version of the vectorial proximal point algorithm with providing its detailed…
▽ More
This paper is devoted to general nonconvex problems of multiobjective optimization in Hilbert spaces. Based on Mordukhovich's limiting subgradients, we define a new notion of Pareto critical points for such problems, establish necessary optimality conditions for them, and then employ these conditions to develop a refined version of the vectorial proximal point algorithm with providing its detailed convergence analysis. The obtained results largely extend those initiated by Bonnel, Iusem and Svaiter \cite{Bonnel2005} for convex vector optimization problems and by Bento et al. \cite{Bento2018} for nonconvex finite-dimensional problems in terms of Clarke's generalized gradients.
△ Less
Submitted 14 March, 2024;
originally announced March 2024.
-
Coderivative-Based Newton Methods in Structured Nonconvex and Nonsmooth Optimization
Authors:
Pham Duy Khanh,
Boris S. Mordukhovich,
Vo Thanh Phat
Abstract:
This paper proposes and develops new Newton-type methods to solve structured nonconvex and nonsmooth optimization problems with justifying their fast local and global convergence by means of advanced tools of variational analysis and generalized differentiation. The objective functions belong to a broad class of prox-regular functions with specification to constrained optimization of nonconvex str…
▽ More
This paper proposes and develops new Newton-type methods to solve structured nonconvex and nonsmooth optimization problems with justifying their fast local and global convergence by means of advanced tools of variational analysis and generalized differentiation. The objective functions belong to a broad class of prox-regular functions with specification to constrained optimization of nonconvex structured sums. We also develop a novel line search method, which is an extension of the proximal gradient algorithm while allowing us to globalize the proposed coderivative-based Newton methods by incorporating the machinery of forward-backward envelopes. Further applications and numerical experiments are conducted for the $\ell_0$-$\ell_2$ regularized least-square model appearing in statistics and machine learning.
△ Less
Submitted 7 March, 2024;
originally announced March 2024.
-
Fundamental Convergence Analysis of Sharpness-Aware Minimization
Authors:
Pham Duy Khanh,
Hoang-Chau Luong,
Boris S. Mordukhovich,
Dat Ba Tran
Abstract:
The paper investigates the fundamental convergence properties of Sharpness-Aware Minimization (SAM), a recently proposed gradient-based optimization method (Foret et al., 2021) that significantly improves the generalization of deep neural networks. The convergence properties including the stationarity of accumulation points, the convergence of the sequence of gradients to the origin, the sequence…
▽ More
The paper investigates the fundamental convergence properties of Sharpness-Aware Minimization (SAM), a recently proposed gradient-based optimization method (Foret et al., 2021) that significantly improves the generalization of deep neural networks. The convergence properties including the stationarity of accumulation points, the convergence of the sequence of gradients to the origin, the sequence of function values to the optimal value, and the sequence of iterates to the optimal solution are established for the method. The universality of the provided convergence analysis based on inexact gradient descent frameworks (Khanh et al., 2023b) allows its extensions to the normalized versions of SAM such as VaSSO (Li & Giannakis, 2023), RSAM (Liu et al., 2022), and to the unnormalized versions of SAM such as USAM (Andriushchenko & Flammarion, 2022). Numerical experiments are conducted on classification tasks using deep learning models to confirm the practical aspects of our analysis.
△ Less
Submitted 29 February, 2024; v1 submitted 15 January, 2024;
originally announced January 2024.
-
Stability Criteria and Calculus Rules via Conic Contingent Coderivatives in Banach Spaces
Authors:
Boris S. Mordukhovich,
Pengcheng Wu,
Xiaoqi Yang
Abstract:
This paper addresses the study of novel constructions of variational analysis and generalized differentiation that are appropriate for characterizing robust stability properties of constrained set-valued map**s/multifunctions between Banach spaces important in optimization theory and its applications. Our tools of generalized differentiation revolves around the newly introduced concept of…
▽ More
This paper addresses the study of novel constructions of variational analysis and generalized differentiation that are appropriate for characterizing robust stability properties of constrained set-valued map**s/multifunctions between Banach spaces important in optimization theory and its applications. Our tools of generalized differentiation revolves around the newly introduced concept of $\varepsilon$-regular normal cone to sets and associated coderivative notions for set-valued map**s. Based on these constructions, we establish several characterizations of the central stability notion known as the relative Lipschitz-like property of set-valued map**s in infinite dimensions. Applying a new version of the constrained extremal principle of variational analysis, we develop comprehensive sum and chain rules for our major constructions of conic contingent coderivatives for multifunctions between appropriate classes of Banach spaces.
△ Less
Submitted 9 January, 2024;
originally announced January 2024.
-
Second-Order Subdifferential Optimality Conditions in Nonsmooth Optimization
Authors:
Pham Duy Khanh,
Vu Vinh Huy Khoa,
Boris S. Mordukhovich,
Vo Thanh Phat
Abstract:
The paper is devoted to deriving novel second-order necessary and sufficient optimality conditions for local minimizers in rather general classes of nonsmooth unconstrained and constrained optimization problems in finite-dimensional spaces. The established conditions are expressed in terms of second-order subdifferentials of lower semicontinuous functions and mainly concern prox-regular objectives…
▽ More
The paper is devoted to deriving novel second-order necessary and sufficient optimality conditions for local minimizers in rather general classes of nonsmooth unconstrained and constrained optimization problems in finite-dimensional spaces. The established conditions are expressed in terms of second-order subdifferentials of lower semicontinuous functions and mainly concern prox-regular objectives that cover a large territory in nonsmooth optimization and its applications. Our tools are based on the machinery of variational analysis and second-order generalized differentiation. The obtained general results are applied to problems of nonlinear programming, where the derived second-order optimality conditions are new even for problems with twice continuously differential data, being expressed there in terms of the classical Hessian matrices.
△ Less
Submitted 26 December, 2023;
originally announced December 2023.
-
Local Minimizers of Nonconvex Functions in Banach Spaces via Moreau Envelopes
Authors:
Pham Duy Khanh,
Vu Vinh Huy Khoa,
Boris S. Mordukhovich,
Vo Thanh Phat
Abstract:
This paper investigates the preservation of local minimizers and strong minimizers of extended-real-valued lower semicontinuous functions under taking their Moreau envelopes. We address a general setting of Banach spaces, while all the obtained results are new even for functions in finite dimensions. Our main motivation came from applications to numerical methods in nonsmooth optimization dealing…
▽ More
This paper investigates the preservation of local minimizers and strong minimizers of extended-real-valued lower semicontinuous functions under taking their Moreau envelopes. We address a general setting of Banach spaces, while all the obtained results are new even for functions in finite dimensions. Our main motivation came from applications to numerical methods in nonsmooth optimization dealing with broad classes of nondifferentiable and nonconvex functions. The paper also formulates and discusses some open questions stemming from this study.
△ Less
Submitted 30 November, 2023;
originally announced November 2023.
-
General Derivative-Free Optimization Methods under Global and Local Lipschitz Continuity of Gradients
Authors:
Pham Duy Khanh,
Boris S. Mordukhovich,
Dat Ba Tran
Abstract:
This paper addresses the study of derivative-free smooth optimization problems, where the gradient information on the objective function is unavailable. Two novel general derivative-free methods are proposed and developed for minimizing such functions with either global or local Lipschitz continuous gradients. The newly developed methods use gradient approximations based on finite differences, whe…
▽ More
This paper addresses the study of derivative-free smooth optimization problems, where the gradient information on the objective function is unavailable. Two novel general derivative-free methods are proposed and developed for minimizing such functions with either global or local Lipschitz continuous gradients. The newly developed methods use gradient approximations based on finite differences, where finite difference intervals are automatically adapted to the magnitude of the exact gradients without knowing them exactly. The suggested algorithms achieve fundamental convergence results, including stationarity of accumulation points in general settings as well as global convergence with constructive convergence rates when the Kurdyka-Łojasiewicz property is imposed. The local convergence of the proposed algorithms to nonisolated local minimizers, along with their local convergence rates, is also analyzed under this property. Numerical experiences involving various convex, nonconvex, noiseless, and noisy functions demonstrate that the new methods exhibit essential advantages over other state-of-the-art methods in derivative-free optimization.
△ Less
Submitted 28 November, 2023;
originally announced November 2023.
-
Optimal control of swee** processes in unmanned surface vehicle and nanoparticle modeling
Authors:
Boris S. Mordukhovich,
Dao Nguyen,
Trang Nguyen
Abstract:
This paper addresses novel applications to practical modeling of the newly developed theory of necessary optimality conditions in controlled swee**/Moreau processes with free time and pointwise control and state constraints. Problems of this type appear, in particular, in dynamical models dealing with unmanned surface vehicles (USVs) and nanoparticles. We formulate optimal control problems for a…
▽ More
This paper addresses novel applications to practical modeling of the newly developed theory of necessary optimality conditions in controlled swee**/Moreau processes with free time and pointwise control and state constraints. Problems of this type appear, in particular, in dynamical models dealing with unmanned surface vehicles (USVs) and nanoparticles. We formulate optimal control problems for a general class of such dynamical systems and show that the developed necessary optimality conditions for constrained free-time controlled swee** processes lead us to designing efficient procedures to solve practical models of this class. Moreover, the paper contains numerical calculations of optimal solutions to marine USVs and nanoparticle models in specific situations. Overall, this study contributes to the advancement of optimal control theory for constrained swee** processes and its practical applications in the fields of marine USVs and nanoparticle modeling.
△ Less
Submitted 21 November, 2023;
originally announced November 2023.
-
Discrete Approximations and Optimality Conditions for Controlled Free-Time Swee** Processes
Authors:
Giovanni Colombo,
Boris S. Mordukhovich,
Dao Nguyen,
Trang Nguyen
Abstract:
The paper is devoted to the study of a new class of optimal control problems governed by discontinuous constrained differential inclusions of the swee** type with involving the duration of the dynamic process into optimization. We develop a novel version of the method of discrete approximations of its own qualitative and numerical values with establishing its well-posedness and strong convergenc…
▽ More
The paper is devoted to the study of a new class of optimal control problems governed by discontinuous constrained differential inclusions of the swee** type with involving the duration of the dynamic process into optimization. We develop a novel version of the method of discrete approximations of its own qualitative and numerical values with establishing its well-posedness and strong convergence to optimal solutions of the controlled swee** process. Using advanced tools of first-order and second-order variational analysis and generalized differentiation allows us to derive new necessary conditions for optimal solutions of the discrete-time problems and then, by passing to the limit in the discretization procedure, for designated local minimizers in the original problem of swee** optimal control. The obtained results are illustrated by a numerical example.
△ Less
Submitted 16 October, 2023;
originally announced October 2023.
-
Variational and Strong Variational Convexity in Infinite-Dimensional Variational Analysis
Authors:
Pham Duy Khanh,
Vu Vinh Huy Khoa,
Boris S. Mordukhovich,
Vo Thanh Phat
Abstract:
This paper is devoted to a systematic study and characterizations of the fundamental notions of variational and strong variational convexity for lower semicontinuous functions. While these notions have been quite recently introduced by Rockafellar, the importance of them has been already recognized and documented in finite-dimensional variational analysis and optimization. Here we address general…
▽ More
This paper is devoted to a systematic study and characterizations of the fundamental notions of variational and strong variational convexity for lower semicontinuous functions. While these notions have been quite recently introduced by Rockafellar, the importance of them has been already recognized and documented in finite-dimensional variational analysis and optimization. Here we address general infinite-dimensional settings and derive comprehensive characterizations of both variational and strong variational convexity notions by develo** novel techniques, which are essentially different from finite-dimensional counterparts. As a consequence of the obtained characterizations, we establish new quantitative and qualitative relationships between strong variational convexity and tilt stability of local minimizers in appropriate frameworks of Banach spaces.
△ Less
Submitted 24 September, 2023;
originally announced September 2023.
-
Local Maximal Monotonicity in Variational Analysis and Optimization
Authors:
Pham Duy Khanh,
Vu Vinh Huy Khoa,
Boris S. Mordukhovich,
Vo Thanh Phat
Abstract:
The paper is devoted to a systematic study and characterizations of notions of local maximal monotonicity and their strong counterparts for set-valued operators that appear in variational analysis, optimization, and their applications. We obtain novel resolvent characterizations of these notions together with efficient conditions for their preservation under summation in broad infinite-dimensional…
▽ More
The paper is devoted to a systematic study and characterizations of notions of local maximal monotonicity and their strong counterparts for set-valued operators that appear in variational analysis, optimization, and their applications. We obtain novel resolvent characterizations of these notions together with efficient conditions for their preservation under summation in broad infinite-dimensional settings. Further characterizations of these notions are derived by using generalized differentiation of variational analysis in the framework of Hilbert spaces.
△ Less
Submitted 27 August, 2023;
originally announced August 2023.
-
A New Inexact Gradient Descent Method with Applications to Nonsmooth Convex Optimization
Authors:
Pham Duy Khanh,
Boris S. Mordukhovich,
Dat Ba Tran
Abstract:
The paper proposes and develops a novel inexact gradient method (IGD) for minimizing C1-smooth functions with Lipschitzian gradients, i.e., for problems of C1,1 optimization. We show that the sequence of gradients generated by IGD converges to zero. The convergence of iterates to stationary points is guaranteed under the Kurdyka- Lojasiewicz (KL) property of the objective function with convergence…
▽ More
The paper proposes and develops a novel inexact gradient method (IGD) for minimizing C1-smooth functions with Lipschitzian gradients, i.e., for problems of C1,1 optimization. We show that the sequence of gradients generated by IGD converges to zero. The convergence of iterates to stationary points is guaranteed under the Kurdyka- Lojasiewicz (KL) property of the objective function with convergence rates depending on the KL exponent. The newly developed IGD is applied to designing two novel gradient-based methods of nonsmooth convex optimization such as the inexact proximal point methods (GIPPM) and the inexact augmented Lagrangian method (GIALM) for convex programs with linear equality constraints. These two methods inherit global convergence properties from IGD and are confirmed by numerical experiments to have practical advantages over some well-known algorithms of nonsmooth convex optimization.
△ Less
Submitted 11 January, 2024; v1 submitted 15 March, 2023;
originally announced March 2023.
-
Coderivative-Based Semi-Newton Method in Nonsmooth Difference Programming
Authors:
Francisco J. Aragón-Artacho,
Boris S. Mordukhovich,
Pedro Pérez-Aros
Abstract:
This paper addresses the study of a new class of nonsmooth optimization problems, where the objective is represented as a difference of two generally nonconvex functions. We propose and develop a novel Newton-type algorithm to solving such problems, which is based on the coderivative generated second-order subdifferential (generalized Hessian) and employs advanced tools of variational analysis. We…
▽ More
This paper addresses the study of a new class of nonsmooth optimization problems, where the objective is represented as a difference of two generally nonconvex functions. We propose and develop a novel Newton-type algorithm to solving such problems, which is based on the coderivative generated second-order subdifferential (generalized Hessian) and employs advanced tools of variational analysis. Well-posedness properties of the proposed algorithm are derived under fairly general requirements, while constructive convergence rates are established by using additional assumptions including the Kurdyka--Łojasiewicz condition. We provide applications of the main algorithm to solving a general class of nonsmooth nonconvex problems of structured optimization that encompasses, in particular, optimization problems with explicit constraints. Finally, applications and numerical experiments are given for solving practical problems that arise in biochemical models, constrained quadratic programming, etc., where advantages of our algorithms are demonstrated in comparison with some known techniques and results.
△ Less
Submitted 9 January, 2023;
originally announced January 2023.
-
Variational Convexity of Functions in Banach Spaces
Authors:
Pham Duy Khanh,
Vu Vinh Huy Khoa,
Boris S. Mordukhovich,
Vo Thanh Phat
Abstract:
This paper addresses the study and characterizations of variational convexity of extended-real-valued functions on Banach spaces. This notion has been recently introduced by Rockafellar, and its importance has been already realized and applied to continuous optimization problems in finite-dimensional spaces. Variational convexity in infinite-dimensional spaces, which is studied here for the first…
▽ More
This paper addresses the study and characterizations of variational convexity of extended-real-valued functions on Banach spaces. This notion has been recently introduced by Rockafellar, and its importance has been already realized and applied to continuous optimization problems in finite-dimensional spaces. Variational convexity in infinite-dimensional spaces, which is studied here for the first time, is significantly more involved and requires the usage of powerful tools of geometric functional analysis together with variational analysis and generalized differentiation in Banach spaces.
△ Less
Submitted 27 August, 2023; v1 submitted 13 December, 2022;
originally announced December 2022.
-
Relative Well-Posedness of Constrained Systems with Applications to Variational Inequalities
Authors:
Boris S. Mordukhovich,
Pengcheng Wu,
Xiaoqi Yang
Abstract:
The paper concerns foundations of sensitivity and stability analysis, being primarily addressed constrained systems. We consider general models, which are described by multifunctions between Banach spaces and concentrate on characterizing their well-posedness properties that revolve around Lipschitz stability and metric regularity relative to sets. The enhanced relative well-posedness concepts all…
▽ More
The paper concerns foundations of sensitivity and stability analysis, being primarily addressed constrained systems. We consider general models, which are described by multifunctions between Banach spaces and concentrate on characterizing their well-posedness properties that revolve around Lipschitz stability and metric regularity relative to sets. The enhanced relative well-posedness concepts allow us, in contrast to their standard counterparts, encompassing various classes of constrained systems. Invoking tools of variational analysis and generalized differentiation, we introduce new robust notions of relative coderivatives. The novel machinery of variational analysis leads us to establishing complete characterizations of the relative well-posedness properties with further applications to stability of affine variational inequalities. Most of the obtained results valid in general infinite-dimensional settings are also new in finite dimensions.
△ Less
Submitted 29 August, 2023; v1 submitted 5 December, 2022;
originally announced December 2022.
-
Optimal Control of a Quasi-Variational Swee** Process
Authors:
Harbir Antil,
Rafael Arndt,
Boris S. Mordukhovich,
Dao Nguyen,
Carlos N. Rautenberg
Abstract:
The paper addresses the study of a class of evolutionary quasi-variational inequalities of the parabolic type arising in the formation and growth models of granular and cohensionless materials. Such models and their mathematical descriptions are highly challenging and require powerful tools of their analysis and implementation. We formulate a space-time continuous optimal control problem for a bas…
▽ More
The paper addresses the study of a class of evolutionary quasi-variational inequalities of the parabolic type arising in the formation and growth models of granular and cohensionless materials. Such models and their mathematical descriptions are highly challenging and require powerful tools of their analysis and implementation. We formulate a space-time continuous optimal control problem for a basic model of this type, develop several regularization and approximation procedures, and establish the existence of optimal solutions for the time-continuous and space-discrete problem. Viewing a version of this problem as a controlled quasi-variational swee** process leads us to deriving necessary optimality conditions for the fully discrete problem by using the advanced machinery of variational analysis and generalized differentiation.
△ Less
Submitted 31 August, 2022;
originally announced September 2022.
-
Variational Convexity of Functions and Variational Sufficiency in Optimization
Authors:
Pham Duy Khanh,
Boris S. Mordukhovich,
Vo Thanh Phat
Abstract:
The paper is devoted to the study, characterizations, and applications of variational convexity of functions, the property that has been recently introduced by Rockafellar together with its strong counterpart. First we show that these variational properties of an extended-real-valued function are equivalent to, respectively, the conventional (local) convexity and strong convexity of its Moreau env…
▽ More
The paper is devoted to the study, characterizations, and applications of variational convexity of functions, the property that has been recently introduced by Rockafellar together with its strong counterpart. First we show that these variational properties of an extended-real-valued function are equivalent to, respectively, the conventional (local) convexity and strong convexity of its Moreau envelope. Then we derive new characterizations of both variational convexity and variational strong convexity of general functions via their second-order subdifferentials (generalized Hessians), which are coderivatives of subgradient map**s. We also study relationships of these notions with local minimizers and tilt-stable local minimizers. The obtained results are used for characterizing related notions of variational and strong variational sufficiency in composite optimization with applications to nonlinear programming.
△ Less
Submitted 26 January, 2023; v1 submitted 30 August, 2022;
originally announced August 2022.
-
Inexact reduced gradient methods in nonconvex optimization
Authors:
Pham Duy Khanh,
Boris S. Mordukhovich,
Dat Ba Tran
Abstract:
This paper proposes and develops new linesearch methods with inexact gradient information for finding stationary points of nonconvex continuously differentiable functions on finite-dimensional spaces. Some abstract convergence results for a broad class of linesearch methods are stablished. A general scheme for inexact reduced gradient (IRG) methods is proposed, where the errors in the gradient app…
▽ More
This paper proposes and develops new linesearch methods with inexact gradient information for finding stationary points of nonconvex continuously differentiable functions on finite-dimensional spaces. Some abstract convergence results for a broad class of linesearch methods are stablished. A general scheme for inexact reduced gradient (IRG) methods is proposed, where the errors in the gradient approximation automatically adapt with the magnitudes of the exact gradients. The sequences of iterations are shown to obtain stationary accumulation points when different stepsize selections are employed. Convergence results with constructive convergence rates for the developed IRG methods are established under the Kurdyka- Lojasiewicz property. The obtained results for the IRG methods are confirmed by encouraging numerical experiments, which demonstrate advantages of automatically controlled errors in IRG methods over other frequently used error selections.
△ Less
Submitted 30 December, 2022; v1 submitted 4 April, 2022;
originally announced April 2022.
-
Coincidence Points of Parameterized Generalized Equations with Applications to Optimal Value Functions
Authors:
Aram V. Arutyunov,
Boris S. Mordukhovich,
Sergey E. Zhukovskiy
Abstract:
The paper studies coincidence points of parameterized set-valued map**s (multifunctions), which provide an extended framework to cover several important topics in variational analysis and optimization that include the existence of solutions of parameterized generalized equations, implicit function and fixed-point theorems, optimal value functions in parametric optimization, etc. Using the advanc…
▽ More
The paper studies coincidence points of parameterized set-valued map**s (multifunctions), which provide an extended framework to cover several important topics in variational analysis and optimization that include the existence of solutions of parameterized generalized equations, implicit function and fixed-point theorems, optimal value functions in parametric optimization, etc. Using the advanced machinery of variational analysis and generalized differentiation that furnishes complete characterizations of well-posedness properties of multifunctions, we establish a general theorem ensuring the existence of parameter-dependent coincidence point map**s with explicit error bounds for parameterized multifunctions between infinite-dimensional spaces. The obtained major result yields a new implicit function theorem and allows us to derive efficient conditions for semicontinuity and continuity of optimal value functions associated with parametric minimization problems subject to constraints governed by parameterized generalized equations.
△ Less
Submitted 21 March, 2022;
originally announced March 2022.
-
Sensitivity Analysis of Stochastic Constraint and Variational Systems via Generalized Differentiation
Authors:
Boris S. Mordukhovich,
Pedro Pérez-Aros
Abstract:
This paper conducts sensitivity analysis of random constraint and variational systems related to stochastic optimization and variational inequalities. We establish efficient conditions for well-posedness, in the sense of robust Lipschitzian stability and/or metric regularity, of such systems by employing and develo** coderivative characterizations of well-posedness properties for random multifun…
▽ More
This paper conducts sensitivity analysis of random constraint and variational systems related to stochastic optimization and variational inequalities. We establish efficient conditions for well-posedness, in the sense of robust Lipschitzian stability and/or metric regularity, of such systems by employing and develo** coderivative characterizations of well-posedness properties for random multifunctions and efficiently evaluating coderivatives of special classes of random integral set-valued map**s that naturally emerge in stochastic programming and stochastic variational inequalities.
△ Less
Submitted 10 December, 2021;
originally announced December 2021.
-
Controlled polyhedral swee** processes: existence, stability, and optimality conditions
Authors:
René Henrion,
Abderrahim Jourani,
Boris S. Mordukhovich
Abstract:
This paper is mainly devoted to the study of controlled swee** processes with polyhedral moving sets in Hilbert spaces. Based on a detailed analysis of truncated Hausdorff distances between moving polyhedra, we derive new existence and uniqueness theorems for swee** trajectories corresponding to various classes of control functions acting in moving sets. Then we establish quantitative stabilit…
▽ More
This paper is mainly devoted to the study of controlled swee** processes with polyhedral moving sets in Hilbert spaces. Based on a detailed analysis of truncated Hausdorff distances between moving polyhedra, we derive new existence and uniqueness theorems for swee** trajectories corresponding to various classes of control functions acting in moving sets. Then we establish quantitative stability results, which provide efficient estimates on the swee** trajectory dependence on controls and initial values. Our final topic, accomplished in finite-dimensional state spaces, is deriving new necessary optimality and suboptimality conditions for swee** control systems with endpoint constrains by using constructive discrete approximations.
△ Less
Submitted 3 December, 2021;
originally announced December 2021.
-
Optimization of Controlled Free-Time Swee** Processes with Applications to Marine Surface Vehicle Modeling
Authors:
Tan H. Cao,
Nathalie T. Khalil,
Boris S. Mordukhovich,
Dao Nguyen,
Trang Nguyen,
Fernando Lobo Pereira
Abstract:
The paper is devoted to a free-time optimal control problem for swee** processes. We develop a constructive finite-difference approximation procedure that allows us to establish necessary optimality conditions for discrete optimal solutions and then show how these optimality conditions are applied to solving a controlled marine surface vehicle model.
The paper is devoted to a free-time optimal control problem for swee** processes. We develop a constructive finite-difference approximation procedure that allows us to establish necessary optimality conditions for discrete optimal solutions and then show how these optimality conditions are applied to solving a controlled marine surface vehicle model.
△ Less
Submitted 7 May, 2021;
originally announced May 2021.
-
Crowd motion paradigm modeled by a bilevel swee** control problem
Authors:
Tan H. Cao,
Nathalie T. Khalil,
Boris S. Mordukhovich,
Dao Nguyen,
Fernando Lobo Pereira
Abstract:
This article concerns an optimal crowd motion control problem in which the crowd features a structure given by its organization into N groups (participants) each one spatially confined in a set. The overall optimal control problem consists in driving the ensemble of sets as close as possible to a given point (the 'exit') while the population in each set minimizes its control effort subject to its…
▽ More
This article concerns an optimal crowd motion control problem in which the crowd features a structure given by its organization into N groups (participants) each one spatially confined in a set. The overall optimal control problem consists in driving the ensemble of sets as close as possible to a given point (the 'exit') while the population in each set minimizes its control effort subject to its swee** dynamics with a controlled state dependent velocity drift. In order to capture the conflict between the goal of the overall population and those of the various groups, the problem is cast as a bilevel optimization framework. A key challenge of this problem consists in bringing together two quite different paradigms: bilevel programming and swee** dynamics with a controlled drift. Necessary conditions of optimality in the form of a Maximum Principle of Pontryagin in the Gamkrelidze framework are derived. These conditions are then used to solve a simple illustrative example with two participants, emphasizing the interaction between them.
△ Less
Submitted 19 April, 2021;
originally announced April 2021.
-
Optimal control of nonconvex integro-differential swee** processes
Authors:
Abderrahim Bouach,
Tahar Haddad,
Boris S. Mordukhovich
Abstract:
This paper is devoted to the study, for the first time in the literature, of optimal control problems for swee** processes governed by integro-differential inclusions of the Volterra type with different classes of control functions acting in nonconvex moving sets, external dynamic perturbations, and integral parts of the swee** dynamics. We establish the existence of optimal solutions and then…
▽ More
This paper is devoted to the study, for the first time in the literature, of optimal control problems for swee** processes governed by integro-differential inclusions of the Volterra type with different classes of control functions acting in nonconvex moving sets, external dynamic perturbations, and integral parts of the swee** dynamics. We establish the existence of optimal solutions and then obtain necessary optimality conditions for a broad class of local minimizers in such problems. Our approach to deriving necessary optimality conditions is based on the method of discrete approximations married to basic constructions and calculus rules of first-order and second-order variational analysis and generalized differentiation. The obtained necessary optimality conditions are expressed entirely in terms of the problem data and are illustrated by nontrivial examples that include applications to optimal control models of non-regular electrical circuits.
△ Less
Submitted 28 March, 2021;
originally announced March 2021.
-
Vector Optimization with Domination Structures: Variational Principles and Applications
Authors:
Truong Q. Bao,
Boris S. Mordukhovich,
Antoine Soubeyran,
Christiane Tammer
Abstract:
This paper addresses a large class of vector optimization problems in infinite-dimensional spaces with respect to two important binary relations derived from domination structures. Motivated by theoretical challenges as well as by applications to some models in behavioral sciences, we establish new variational principles that can be viewed as far-going extensions of the Ekeland variational princip…
▽ More
This paper addresses a large class of vector optimization problems in infinite-dimensional spaces with respect to two important binary relations derived from domination structures. Motivated by theoretical challenges as well as by applications to some models in behavioral sciences, we establish new variational principles that can be viewed as far-going extensions of the Ekeland variational principle to cover domination vector settings. Our approach combines advantages of both primal and dual techniques in variational analysis with providing useful suficient conditions for the existence of variational traps in behavioral science models with variable domination structures.
△ Less
Submitted 16 February, 2021;
originally announced February 2021.
-
Generalized Leibniz rules and Lipschitzian stability for expected-integral map**s
Authors:
Boris S. Mordukhovich,
Pedro Pérez-Aros
Abstract:
This paper is devoted to the study of the expected-integral multifunctions given in the form \begin{equation*} \operatorname{E}_Φ(x):=\int_TΦ_t(x)dμ, \end{equation*} where $Φ\colon T\times\mathbb{R}^n \rightrightarrows \mathbb{R}^m$ is a set-valued map** on a measure space $(T,\mathcal{A},μ)$. Such multifunctions appear in applications to stochastic programming, which require develo** efficien…
▽ More
This paper is devoted to the study of the expected-integral multifunctions given in the form \begin{equation*} \operatorname{E}_Φ(x):=\int_TΦ_t(x)dμ, \end{equation*} where $Φ\colon T\times\mathbb{R}^n \rightrightarrows \mathbb{R}^m$ is a set-valued map** on a measure space $(T,\mathcal{A},μ)$. Such multifunctions appear in applications to stochastic programming, which require develo** efficient calculus rules of generalized differentiation. Major calculus rules are developed in this paper for coderivatives of multifunctions $\operatorname{E}_Φ$ and second-order subdifferentials of the corresponding expected-integral functionals with applications to constraint systems arising in stochastic programming. The paper is self-contained with presenting in the preliminaries some needed results on sequential first-order subdifferential calculus of expected-integral functionals taken from the first paper of this series.
△ Less
Submitted 18 June, 2021; v1 submitted 17 January, 2021;
originally announced January 2021.
-
Optimization of Fully Controlled Swee** Processes
Authors:
Tan H. Cao,
Giovanni Colombo,
Boris S. Mordukhovich,
Dao Nguyen
Abstract:
The paper is devoted to deriving necessary optimality conditions in a general optimal control problem for dynamical systems governed by controlled swee** processes with hard-constrained control actions entering both polyhedral moving sets and additive perturbations. By using the first-order and mainly second-order tools of variational analysis and generalized differentiation, we develop a well-p…
▽ More
The paper is devoted to deriving necessary optimality conditions in a general optimal control problem for dynamical systems governed by controlled swee** processes with hard-constrained control actions entering both polyhedral moving sets and additive perturbations. By using the first-order and mainly second-order tools of variational analysis and generalized differentiation, we develop a well-posed method of discrete approximations, obtain optimality conditions for solutions to discrete-time control systems, and then establish by passing to the limit verifiable necessary optimality conditions for local minimizers of the original controlled swee** process that are expressed entirely in terms of its given data. The efficiency of the obtained necessary optimality conditions for the swee** dynamics is illustrated by solving three nontrivial examples of their own interest.
△ Less
Submitted 16 March, 2021; v1 submitted 21 December, 2020;
originally announced December 2020.
-
A Globally Convergent Proximal Newton-Type Method in Nonsmooth Convex Optimization
Authors:
Boris S. Mordukhovich,
Xiaoming Yuan,
Shangzhi Zeng,
** Zhang
Abstract:
The paper proposes and justifies a new algorithm of the proximal Newton type to solve a broad class of nonsmooth composite convex optimization problems without strong convexity assumptions. Based on advanced notions and techniques of variational analysis, we establish implementable results on the global convergence of the proposed algorithm as well as its local convergence with superlinear and qua…
▽ More
The paper proposes and justifies a new algorithm of the proximal Newton type to solve a broad class of nonsmooth composite convex optimization problems without strong convexity assumptions. Based on advanced notions and techniques of variational analysis, we establish implementable results on the global convergence of the proposed algorithm as well as its local convergence with superlinear and quadratic rates. For certain structured problems, the obtained local convergence conditions do not require the local Lipschitz continuity of the corresponding Hessian map**s that is a crucial assumption used in the literature to ensure a superlinear convergence of other algorithms of the proximal Newton type. The conducted numerical experiments of solving the $l_1$ regularized logistic regression model illustrate the possibility of applying the proposed algorithm to deal with practically important problems.
△ Less
Submitted 28 February, 2022; v1 submitted 16 November, 2020;
originally announced November 2020.
-
Generalized Sequential Differential Calculus for Expected-Integral Functionals
Authors:
Boris S. Mordukhovich,
Pedro Pérez-Aros
Abstract:
Motivated by applications to stochastic programming, we introduce and study the expected-integral functionals, which are map**s given in an integral form depending on two variables, the first a finite dimensional decision vector and the second one an integrable function. The main goal of this paper is to establish sequential versions of Leibniz's rule for regular subgradients by employing and de…
▽ More
Motivated by applications to stochastic programming, we introduce and study the expected-integral functionals, which are map**s given in an integral form depending on two variables, the first a finite dimensional decision vector and the second one an integrable function. The main goal of this paper is to establish sequential versions of Leibniz's rule for regular subgradients by employing and develo** appropriate tools of variational analysis.
△ Less
Submitted 13 June, 2021; v1 submitted 25 September, 2020;
originally announced September 2020.
-
Augmented Lagrangian Method for Second-Order Cone Programs under Second-Order Sufficiency
Authors:
Nguyen T. V. Hang,
Boris S. Mordukhovich,
M. Ebrahim Sarabi
Abstract:
This paper addresses problems of second-order cone programming important in optimization theory and applications. The main attention is paid to the augmented Lagrangian method (ALM) for such problems considered in both exact and inexact forms. Using generalized differential tools of second-order variational analysis, we formulate the corresponding version of second-order sufficiency and use it to…
▽ More
This paper addresses problems of second-order cone programming important in optimization theory and applications. The main attention is paid to the augmented Lagrangian method (ALM) for such problems considered in both exact and inexact forms. Using generalized differential tools of second-order variational analysis, we formulate the corresponding version of second-order sufficiency and use it to establish, among other results, the uniform second-order growth condition for the augmented Lagrangian. The latter allows us to justify the solvability of subproblems in the ALM and to prove the linear primal-dual convergence of this method.
△ Less
Submitted 5 July, 2021; v1 submitted 8 May, 2020;
originally announced May 2020.
-
Discrete Approximations and Optimal Control of Nonsmooth Perturbed Swee** Processes
Authors:
Boris S. Mordukhovich,
Dao Nguyen
Abstract:
The main goal of this paper is develo** the method of discrete approximations to derive necessary optimality conditions for a class of constrained swee** processes with nonsmooth perturbations. Optimal control problems for swee** processes have been recently recognized among the most interesting and challenging problems in modern control theory for discontinuous differential inclusions with…
▽ More
The main goal of this paper is develo** the method of discrete approximations to derive necessary optimality conditions for a class of constrained swee** processes with nonsmooth perturbations. Optimal control problems for swee** processes have been recently recognized among the most interesting and challenging problems in modern control theory for discontinuous differential inclusions with irregular dynamics and implicit state constrained, while deriving necessary optimality conditions for their local minimizers have been significantly based on the smoothness of controlled dynamic perturbations. To overcome these difficulties, we use the method of discrete approximations and employ advanced tools of second-order variational analysis. This approach allows us to obtain new necessary optimality conditions for nonsmooth and nonconvex discrete-time problems of the swee** type. Then we employ the obtained conditions and the strong convergence of discrete approximations to establish novel results for original nonsmooth swee** control problems that include extended Euler-Lagrange and maximization conditions for local minimizers. Finally, we present applications of the obtained results to solving a controlled mobile robot model with a nonsmooth swee** dynamics that is of some practical interest.
△ Less
Submitted 12 May, 2020; v1 submitted 28 April, 2020;
originally announced April 2020.
-
Optimization and Discrete Approximation of Swee** Processes with Controlled Moving Sets and Perturbations
Authors:
Tan H. Cao,
Giovanni Colombo,
Boris S. Mordukhovich,
Dao Nguyen
Abstract:
This paper addresses a new class of optimal control problems for perturbed swee** processes with measurable controls in additive perturbations of the dynamics and smooth controls in polyhedral moving sets. We develop a constructive discrete approximation procedure that allows us to strongly approximate any feasible trajectory of the controlled swee** process by feasible discrete trajectories a…
▽ More
This paper addresses a new class of optimal control problems for perturbed swee** processes with measurable controls in additive perturbations of the dynamics and smooth controls in polyhedral moving sets. We develop a constructive discrete approximation procedure that allows us to strongly approximate any feasible trajectory of the controlled swee** process by feasible discrete trajectories and also establish a $W^{1,2}$-strong convergence of optimal trajectories for discretized control problems to a given local minimizer of the original continuous-time swee** control problem of the Bolza type. Employing advanced tools of first-order and second-order variational analysis and generalized differentiation, we derive necessary optimality conditions for discrete optimal solutions under fairly general assumptions formulated entirely in terms of the given data. The obtained results give us efficient suboptimality ("almost optimality") conditions for the original swee** control problem that are illustrated by a nontrivial numerical example.
△ Less
Submitted 13 February, 2020;
originally announced February 2020.
-
Feedback Stabilization of Nonlinear Control Systems by Composition Operators
Authors:
Bryce A. Christopherson,
Boris S. Mordukhovich,
Farhad Jafari
Abstract:
Feedback asymptotic stabilization of control systems is an important topic of control theory and applications. Broadly speaking, if the system $\dot{x} = f(x,u)$ is locally asymptotically stabilizable, then there exists a feedback control $u(x)$ ensuring the convergence to an equilibrium for any trajectory starting from a point sufficiently close to the equilibrium state. In this paper, we develop…
▽ More
Feedback asymptotic stabilization of control systems is an important topic of control theory and applications. Broadly speaking, if the system $\dot{x} = f(x,u)$ is locally asymptotically stabilizable, then there exists a feedback control $u(x)$ ensuring the convergence to an equilibrium for any trajectory starting from a point sufficiently close to the equilibrium state. In this paper, we develop a reasonably natural and general composition operator approach to stabilizability. To begin with, we provide an extension of the classical Hautus lemma to the generalized context of composition operators and show that Brockett's theorem is still necessary for local asymptotic stabilizability in this generalized framework. Further, we employ a powerful version of the implicit function theorem--as given by Jittorntrum and Kumagai--to cover stabilization without differentiability requirements in this expanded context. Employing the obtained characterizations, we establish relationships between stabilizability in the conventional sense and in the generalized composition operator sense. This connection allows us to show that the stabilizability of a control system is equivalent to the stability of an associated system. That is, we reduce the question of stabilizability to that of stability.
△ Less
Submitted 18 September, 2021; v1 submitted 23 January, 2020;
originally announced January 2020.
-
Algebraic Core and Convex Calculus without Topology
Authors:
Dang Van Cuong,
Boris S. Mordukhovich,
Nguyen Mau Nam,
Addison Cartmell
Abstract:
In this paper we study the concept of algebraic core for convex sets in general vector spaces without any topological structure and then present its applications to problems of convex analysis and optimization. Deriving the equivalence between the Hahn-Banach theorem and and a simple version of the separation theorem of convex sets in vector spaces allows us to develop a geometric approach to gene…
▽ More
In this paper we study the concept of algebraic core for convex sets in general vector spaces without any topological structure and then present its applications to problems of convex analysis and optimization. Deriving the equivalence between the Hahn-Banach theorem and and a simple version of the separation theorem of convex sets in vector spaces allows us to develop a geometric approach to generalized differential calculus for convex sets, set-valued map**s, and extended-real-valued functions with qualification conditions formulated in terms of algebraic cores for such objects. We also obtain a precise formula for computing the subdifferential of optimal value functions associated with convex problems of parametric optimization in vector spaces. Functions of this type play a crucial role in many aspects of convex optimization and its applications.
△ Less
Submitted 5 February, 2020; v1 submitted 1 January, 2020;
originally announced January 2020.
-
New extremal principles with applications to stochastic and semi-infinite programming
Authors:
Boris S. Mordukhovich,
Pedro Pérez-Aros
Abstract:
This paper develops new extremal principles of variational analysis that are motivated by applications to constrained problems of stochastic programming and semi-infinite programming without smoothness and/or convexity assumptions. These extremal principles concern measurable set-valued map**s/multifunctions with values in finite-dimensional spaces and are established in both approximate and exa…
▽ More
This paper develops new extremal principles of variational analysis that are motivated by applications to constrained problems of stochastic programming and semi-infinite programming without smoothness and/or convexity assumptions. These extremal principles concern measurable set-valued map**s/multifunctions with values in finite-dimensional spaces and are established in both approximate and exact forms. The obtained principles are instrumental to derive via variational approaches integral representations and upper estimates of regular and limiting normals cones to essential intersections of sets defined by measurable multifunctions, which are in turn crucial for novel applications to stochastic and semi-infinite programming.
△ Less
Submitted 22 July, 2020; v1 submitted 25 November, 2019;
originally announced November 2019.
-
Subdifferentials of Value Functions in Nonconvex Dynamic Programming for Nonstationary Stochastic Processes
Authors:
Boris S. Mordukhovich,
Nobusumi Sagara
Abstract:
The main goal of this paper is to apply the machinery of variational analysis and generalized differentiation to study infinite horizon stochastic dynamic programming (DP) with discrete time in the Banach space setting without convexity assumptions. Unlike to standard stochastic DP with stationary Markov processes, we investigate here stochastic DP in $L^p$ spaces to deal with nonstationary stocha…
▽ More
The main goal of this paper is to apply the machinery of variational analysis and generalized differentiation to study infinite horizon stochastic dynamic programming (DP) with discrete time in the Banach space setting without convexity assumptions. Unlike to standard stochastic DP with stationary Markov processes, we investigate here stochastic DP in $L^p$ spaces to deal with nonstationary stochastic processes, which describe a more flexible learning procedure for the decision-maker. Our main concern is to calculate generalized subgradients of the corresponding value function and to derive necessary conditions for optimality in terms of the stochastic Euler inclusion under appropriate Lipschitzian assumptions. The usage of the subdifferential formula for integral functionals on $L^p$ spaces allows us, in particular, to find verifiable conditions to ensure smoothness of the value function without any convexity and/or interiority assumptions.
△ Less
Submitted 1 September, 2019;
originally announced September 2019.
-
Parabolic Regularity in Geometric Variational Analysis
Authors:
Ashkan Mohammadi,
Boris S. Mordukhovich,
M. Ebrahim Sarabi
Abstract:
The paper is mainly devoted to systematic developments and applications of geometric aspects of second-order variational analysis that are revolved around the concept of parabolic regularity of sets. This concept has been known in variational analysis for more than two decades while being largely underinvestigated. We discover here that parabolic regularity is the key to derive new calculus rules…
▽ More
The paper is mainly devoted to systematic developments and applications of geometric aspects of second-order variational analysis that are revolved around the concept of parabolic regularity of sets. This concept has been known in variational analysis for more than two decades while being largely underinvestigated. We discover here that parabolic regularity is the key to derive new calculus rules and computation formulas for major second-order generalized differential constructions of variational analysis in connection with some properties of sets that go back to classical differential geometry and geometric measure theory. The established results of second-order variational analysis and generalized differentiation, being married to the developed calculus of parabolic regularity, allow us to obtain novel applications to both qualitative and quantitative/numerical aspects of constrained optimization including second-order optimality conditions, augmented Lagrangians, etc. under weak constraint qualifications.
△ Less
Submitted 16 June, 2020; v1 submitted 31 August, 2019;
originally announced September 2019.
-
Bilevel Optimization and Variational Analysis
Authors:
Boris S. Mordukhovich
Abstract:
This chapter presents a self-contained approach of variational analysis and generalized differentiation to deriving necessary optimality in problems of bilevel optimization with Lipschitzian data. We mainly concentrate on optimistic models, although the developed machinery also applies to pessimistic versions. Some open problems are posed and discussed.
This chapter presents a self-contained approach of variational analysis and generalized differentiation to deriving necessary optimality in problems of bilevel optimization with Lipschitzian data. We mainly concentrate on optimistic models, although the developed machinery also applies to pessimistic versions. Some open problems are posed and discussed.
△ Less
Submitted 13 July, 2019;
originally announced July 2019.
-
Variational Analysis of Composite Models with Applications to Continuous Optimization
Authors:
Ashkan Mohammadi,
Boris S. Mordukhovich,
M. Ebrahim Sarabi
Abstract:
The paper is devoted to a comprehensive study of composite models in variational analysis and optimization the importance of which for numerous theoretical, algorithmic, and applied issues of operations research is difficult to overstate. The underlying theme of our study is a systematical replacement of conventional metric regularity and related requirements by much weaker metric subregulatity on…
▽ More
The paper is devoted to a comprehensive study of composite models in variational analysis and optimization the importance of which for numerous theoretical, algorithmic, and applied issues of operations research is difficult to overstate. The underlying theme of our study is a systematical replacement of conventional metric regularity and related requirements by much weaker metric subregulatity ones that lead us to significantly stronger and completely new results of first-order and second-order variational analysis and optimization. In this way we develop extended calculus rules for first-order and second-order generalized differential constructions with paying the main attention in second-order variational theory to the new and rather large class of fully subamenable compositions. Applications to optimization include deriving enhanced no-gap second order optimality conditions in constrained composite models, complete characterizations of the uniqueness of Lagrange multipliers and strong metric subregularity of KKT systems in parametric optimization, etc.
△ Less
Submitted 7 December, 2019; v1 submitted 21 May, 2019;
originally announced May 2019.
-
A Variational Approach to Local Asymptotic and Exponential Stabilization of Nonlinear Systems
Authors:
Bryce A. Christopherson,
Farhad Jafari,
Boris S. Mordukhovich
Abstract:
Local asymptotic stabilizability is a topic of great theoretical interest and practical importance. Broadly, if a system $\dot{x} = f(x,u)$ is locally asymptotically stabilizable, we are guaranteed a feedback controller $u(x)$ that forces convergence to an equilibrium for trajectories initialized sufficiently close to it. A necessary condition was given by Brockett: such controllers exist only whe…
▽ More
Local asymptotic stabilizability is a topic of great theoretical interest and practical importance. Broadly, if a system $\dot{x} = f(x,u)$ is locally asymptotically stabilizable, we are guaranteed a feedback controller $u(x)$ that forces convergence to an equilibrium for trajectories initialized sufficiently close to it. A necessary condition was given by Brockett: such controllers exist only when $f$ is open at the equilibrium. Recently, Gupta, Jafari, Kipka and Mordukhovich considered a modification to this condition, replacing Brockett's topological openness by the linear openness property of modern variational analysis. In this paper, we show that under the linear openness assumption there is a local diffeomorphism of neighborhoods of the equilibirum on which the system is exponentially stabilizable by means of continuous stationary feedback laws. Introducing a transversality property and relating it to the above diffeomorphism, we prove that linear openness and transversality on a punctured neighborhood of an equilibrium is sufficient for local exponential stabilizability of systems with a rank deficient linearization.The main result goes beyond the usual Kalman and Hautus criteria for the existence of exponential stabilizing feedback laws, since it allows us to handle systems for which exponential stabilization is achieved through higher-order terms. However, it is implemented so far under a rather restrictive row-rank conditions. This suggests a twofold approach to the use of these properties: a point-wise version is enough to ensure stability via the linearization, while a local version is enough to overcome deficiencies in the linearization.
△ Less
Submitted 17 December, 2019; v1 submitted 27 February, 2019;
originally announced February 2019.
-
Explicit Formula for Preimages of Relaxed One-Sided Lipschitz Map**s with Negative Lipschitz Constants
Authors:
Andrew C. Eberhard,
Boris S. Mordukhovich,
Janosch Rieger
Abstract:
This paper addresses Lipschitzian stability issues that play an important role in both theoretical and numerical aspects of variational analysis, optimization, and their applications. We particularly concentrate on the so-called relaxed one-sided Lipschitz property of set-valued map**s with negative Lipschitz constants. This property has been much less investigated than more conventional Lipschi…
▽ More
This paper addresses Lipschitzian stability issues that play an important role in both theoretical and numerical aspects of variational analysis, optimization, and their applications. We particularly concentrate on the so-called relaxed one-sided Lipschitz property of set-valued map**s with negative Lipschitz constants. This property has been much less investigated than more conventional Lipschitzian behavior while being well recognized in a variety of applications. Recent work has revealed that set-valued map**s satisfying the relaxed one-sided Lipschitz condition with negative Lipschitz constant possess a localization property that is stronger than uniform metric regularity. The present paper complements this fact by providing a characterization not only of one specific single point of a preimage, but of entire preimages of such map**s. Develo** a geometric approach, we derive an explicit formula to calculate preimages of relaxed one-sided Lipschitz map**s between finite-dimensional spaces and obtain a further specification of this formula via extreme points of image sets.
△ Less
Submitted 25 February, 2019; v1 submitted 4 February, 2019;
originally announced February 2019.
-
Quasi-Relative Interiors for Graphs of Convex Set-Valued Map**s
Authors:
Dang Van Cuong,
Boris S. Mordukhovich,
Nguyen Mau Nam
Abstract:
This paper aims at providing further studies of the notion of quasi-relative interior for convex sets introduced by Borwein and Lewis. We obtain new formulas for representing quasi-relative interiors of convex graphs of set-valued map**s and for convex epigraphs of extended-real-valued functions defined on locally convex topological vector spaces. We also show that the role, which this notion pl…
▽ More
This paper aims at providing further studies of the notion of quasi-relative interior for convex sets introduced by Borwein and Lewis. We obtain new formulas for representing quasi-relative interiors of convex graphs of set-valued map**s and for convex epigraphs of extended-real-valued functions defined on locally convex topological vector spaces. We also show that the role, which this notion plays in infinite dimensions and the results obtained in this vein, are similar to those involving relative interior in finite-dimensional spaces.
△ Less
Submitted 24 March, 2023; v1 submitted 3 December, 2018;
originally announced December 2018.
-
Optimal Control of Swee** Processes in Robotics and Traffic Flow Models
Authors:
Giovanni Colombo,
Boris S. Mordukhovich,
Dao Nguyen
Abstract:
The paper is mostly devoted to applications of a novel optimal control theory for perturbed swee**/Moreau processes to two practical dynamical models. The first model addresses mobile robot dynamics with obstacles, and the second one concerns control and optimization of traffic flows. Describing these models as controlled swee** processes with pointwise/hard control and state constraints and a…
▽ More
The paper is mostly devoted to applications of a novel optimal control theory for perturbed swee**/Moreau processes to two practical dynamical models. The first model addresses mobile robot dynamics with obstacles, and the second one concerns control and optimization of traffic flows. Describing these models as controlled swee** processes with pointwise/hard control and state constraints and applying new necessary optimality conditions for such systems allow us to develop efficient procedures to solve naturally formulated optimal control problems for the models under consideration and completely calculate optimal solutions in particular situations.
△ Less
Submitted 5 November, 2018;
originally announced November 2018.
-
Characterizations of Tilt-Stable Minimizers in Second-Order Cone Programming
Authors:
Matúš Benko,
Helmut Gfrerer,
Boris S. Mordukhovich
Abstract:
This paper is devoted to the study of tilt stability of local minimizers, which plays an important role in both theoretical and numerical aspects of optimization. This notion has been comprehensively investigated in the unconstrained framework as well as for problems of nonlinear programming with $C^2$-smooth data. Available results for nonpolyhedral conic programs were obtained only under strong…
▽ More
This paper is devoted to the study of tilt stability of local minimizers, which plays an important role in both theoretical and numerical aspects of optimization. This notion has been comprehensively investigated in the unconstrained framework as well as for problems of nonlinear programming with $C^2$-smooth data. Available results for nonpolyhedral conic programs were obtained only under strong constraint nondegeneracy assumptions. Here we develop an approach of second-order variational analysis, which allows us to establish complete neighborhood and pointbased characterizations of tilt stability for problems of second-order cone programming generated by the nonpolyhedral second-order/Lorentz/ice-cream cone. These characterizations are established under the weakest metric subregularity constraint qualification condition.
△ Less
Submitted 10 September, 2018;
originally announced September 2018.
-
Optimization of a perturbed swee** process by constrained discontinuous controls
Authors:
Giovanni Colombo,
Boris S. Mordukhovich,
Dao Nguyen
Abstract:
This paper deals with optimal control problems described by a controlled version of Moreau's swee** process governed by convex polyhedra, where measurable control actions enter additive perturbations. This class of problems, which addresses unbounded discontinuous differential inclusions with intrinsic state constraints, is truly challenging and underinvestigated in control theory while being hi…
▽ More
This paper deals with optimal control problems described by a controlled version of Moreau's swee** process governed by convex polyhedra, where measurable control actions enter additive perturbations. This class of problems, which addresses unbounded discontinuous differential inclusions with intrinsic state constraints, is truly challenging and underinvestigated in control theory while being highly important for various applications. To attack such problems with constrained measurable controls, we develop a refined method of discrete approximations with establishing its well-posedness and strong convergence. This approach, married to advanced tools of first-order and second-order variational analysis and generalized differentiations, allows us to derive adequate collections of necessary optimality conditions for local minimizers, first in discrete-time problems and then in the original continuous-time controlled swee** process by passing to the limit. The new results include an appropriate maximum condition and significantly extend the previous ones obtained under essentially more restrictive assumptions. We compare them with other versions of the maximum principle for controlled swee** processes that have been recently established for global minimizers in problems with smooth swee** sets by using different techniques. The obtained necessary optimality conditions are illustrated by several examples.
△ Less
Submitted 12 August, 2018;
originally announced August 2018.
