-
Archimedean l-groups with strong unit: cozero-sets and coincidence of types of ideals
Authors:
Papiya Bhattacharjee,
Anthony W. Hager,
Warren Wm. McGovern,
Brian Wynne
Abstract:
$\bf{W}^*$ is the category of the archimedean l-groups with distinguished strong order unit and unit-preserving l-group homomorphisms. For $G \in \bf{W}^*$, we have the canonical compact space $YG$, and Yosida representation $G \leq C(YG)$, thus, for $g \in G$, the cozero-set coz(g) in $YG$. The ideals at issue in $G$ include the principal ideals and polars, $G(g)$ and $g^{\perp \perp}…
▽ More
$\bf{W}^*$ is the category of the archimedean l-groups with distinguished strong order unit and unit-preserving l-group homomorphisms. For $G \in \bf{W}^*$, we have the canonical compact space $YG$, and Yosida representation $G \leq C(YG)$, thus, for $g \in G$, the cozero-set coz(g) in $YG$. The ideals at issue in $G$ include the principal ideals and polars, $G(g)$ and $g^{\perp \perp}$, respectively, and the $\bf{W}^*$-kernels of $\bf{W}^*$-morphisms from $G$. The ``coincidences of types" include these properties of $G$: (M) Each $G(g) = g^{\perp \perp}$; (Y) Each $G(g)$ is a $\bf{W}^*$-kernel; (CR) Each $g^{\perp \perp}$ is a $\bf{W}^*$-kernel (iff each coz(g) is regular open). For each of these, we give numerous ``rephrasings", and examples, and note that (M) = (Y) $\cap$ (CR). This paper is a companion to a paper in preparation by the present authors, which includes the present thrust in contexts less restrictive and more algebraic. Here, the focus on $\bf{W}^*$ brings topology to bear, and sharpens the view.
△ Less
Submitted 29 April, 2024;
originally announced April 2024.
-
Sufficiently many projections in archimedean vector lattices with weak order unit
Authors:
Anthony W. Hager,
Brian Wynne
Abstract:
The property of a vector lattice of sufficiently many projections (SMP) is informed by restricting attention to archimedean $A$ with a distinguished weak order unit $u$ (the class, or category, $\bf{W}$), where the Yosida representation $A \leq D(Y(A,u))$ is available. Here, $A$ SMP is equivalent to $Y(A,u)$ having a $π$-base of clopen sets of a certain type called ``local". If the unit is strong,…
▽ More
The property of a vector lattice of sufficiently many projections (SMP) is informed by restricting attention to archimedean $A$ with a distinguished weak order unit $u$ (the class, or category, $\bf{W}$), where the Yosida representation $A \leq D(Y(A,u))$ is available. Here, $A$ SMP is equivalent to $Y(A,u)$ having a $π$-base of clopen sets of a certain type called ``local". If the unit is strong, all clopen sets are local and $A$ is SMP if and only if $Y(A,u)$ has clopen $π$-base, a property we call $π$-zero-dimensional ($π$ZD). The paper is in two parts: the first explicates the similarities of SMP and $π$ZD; the second consists of examples, including $π$ZD but not SMP, and constructions of many SMP's which seem scarce in the literature.
△ Less
Submitted 26 April, 2024;
originally announced April 2024.
-
Extension of Switch Point Algorithm to Boundary-Value Problems
Authors:
William W. Hager
Abstract:
In an earlier paper (https://doi.org/10.1137/21M1393315), the Switch Point Algorithm was developed for solving optimal control problems whose solutions are either singular or bang-bang or both singular and bang-bang, and which possess a finite number of jump discontinuities in an optimal control at the points in time where the solution structure changes. The class of control problems that were con…
▽ More
In an earlier paper (https://doi.org/10.1137/21M1393315), the Switch Point Algorithm was developed for solving optimal control problems whose solutions are either singular or bang-bang or both singular and bang-bang, and which possess a finite number of jump discontinuities in an optimal control at the points in time where the solution structure changes. The class of control problems that were considered had a given initial condition, but no terminal constraint. The theory is now extended to include problems with both initial and terminal constraints, a structure that often arises in boundary-value problems. Substantial changes to the theory are needed to handle this more general setting. Nonetheless, the derivative of the cost with respect to a switch point is again the jump in the Hamiltonian at the switch point.
△ Less
Submitted 18 July, 2023;
originally announced July 2023.
-
How Segregation Patterns Affect the Availability of Fair District Plans
Authors:
William Hager,
Betseygail Rand
Abstract:
We create 4200 synthetic cities which vary in percent minority population and their residential segregation patterns. Of these, 1200 are modeled on existing cities, and 3000 are rectangular grid cities. In each city, we consider single-member voting district plans for a hypothetical city council election. A fair district plan is defined as one where the number of minority-majority districts is pro…
▽ More
We create 4200 synthetic cities which vary in percent minority population and their residential segregation patterns. Of these, 1200 are modeled on existing cities, and 3000 are rectangular grid cities. In each city, we consider single-member voting district plans for a hypothetical city council election. A fair district plan is defined as one where the number of minority-majority districts is proportional to the city-wide minority population. Thus each city is summarized by three traits: minority percent, a measure of segregation, and availability of a fair district plan. We find that when the minority population is around 25%-33%, there is a positive correlation between the degree of segregation and the availability of proportional district plan. Consistently, when the minority population lives in a more diffuse residential pattern, there are fewer available proportional district plans. Finally, we develop a new method to validate runtime and sample size of an ensemble of district plans created by the GerryChain software program.
△ Less
Submitted 28 August, 2022;
originally announced August 2022.
-
Optimally Controlling Nutrition and Propulsion Force in a Long Distance Running Race
Authors:
Cameron Cook,
Suzanne Lenhart,
William Hager,
Guoxun Chen
Abstract:
Runners competing in races are looking to optimize their performance. In this paper, a runner's performance in a race, such as a marathon, is formulated as an optimal control problem where the controls are: the nutrition intake throughout the race and the propulsion force of the runner. As nutrition is an integral part of successfully running long distance races, it needs to be included in models…
▽ More
Runners competing in races are looking to optimize their performance. In this paper, a runner's performance in a race, such as a marathon, is formulated as an optimal control problem where the controls are: the nutrition intake throughout the race and the propulsion force of the runner. As nutrition is an integral part of successfully running long distance races, it needs to be included in models of running strategies. We formulate a system of ordinary differential equations to represent the velocity, fat energy, glycogen energy, and nutrition for a runner competing in a long-distance race. The energy compartments represent the energy sources available in the runner's body. We allocate the energy source from which the runner draws, based on how fast the runner is moving. The food consumed during the race is a source term for the nutrition differential equation. With our model, we are investigating strategies to manage the nutrition and propulsion force in order to minimize the running time in a fixed distance race. This requires the solution of a nontrivial singular control problem. Our results confirm the belief that the most effective way to run a race is to run approximately the same pace the entire race without letting one's energies hit zero.
△ Less
Submitted 23 August, 2022;
originally announced August 2022.
-
A Gradient-Based Implementation of the Polyhedral Active Set Algorithm
Authors:
William W. Hager,
Hongchao Zhang
Abstract:
The Polyhedral Active Set Algorithm (PASA) is designed to optimize a general nonlinear function over a polyhedron. Phase one of the algorithm is a nonmonotone gradient projection algorithm, while phase two is an active set algorithm that explores faces of the constraint polyhedron. A gradient-based implementation is presented, where a projected version of the conjugate gradient algorithm is employ…
▽ More
The Polyhedral Active Set Algorithm (PASA) is designed to optimize a general nonlinear function over a polyhedron. Phase one of the algorithm is a nonmonotone gradient projection algorithm, while phase two is an active set algorithm that explores faces of the constraint polyhedron. A gradient-based implementation is presented, where a projected version of the conjugate gradient algorithm is employed in phase two. Asymptotically, only phase two is performed. Comparisons are given with IPOPT using polyhedral constrained problems from CUTEst and the Maros/Meszaros quadratic programming test set.
△ Less
Submitted 9 September, 2022; v1 submitted 10 February, 2022;
originally announced February 2022.
-
NPASA: An algorithm for nonlinear programming -- Motivation and Global Convergence
Authors:
James Diffenderfer,
William W. Hager
Abstract:
In this paper, we present a two phase method for solving nonlinear programming problems called Nonlinear Polyhedral Active Set Algorithm (NPASA) that has global and local convergence guarantees under reasonable assumptions. The first phase consists of an augmented Lagrangian method to ensure global convergence while the second phase is designed to promote fast local convergence by performing a bal…
▽ More
In this paper, we present a two phase method for solving nonlinear programming problems called Nonlinear Polyhedral Active Set Algorithm (NPASA) that has global and local convergence guarantees under reasonable assumptions. The first phase consists of an augmented Lagrangian method to ensure global convergence while the second phase is designed to promote fast local convergence by performing a balanced reduction of two error estimators for nonlinear programs. After presenting error estimators for nonlinear programs and our algorithm NPASA, we establish global convergence properties for NPASA. Local quadratic convergence of NPASA is established in a companion paper.
△ Less
Submitted 15 July, 2021;
originally announced July 2021.
-
NPASA: An algorithm for nonlinear programming -- Local Convergence
Authors:
James Diffenderfer,
William W. Hager
Abstract:
In this paper, we provide local convergence analysis for the two phase Nonlinear Polyhedral Active Set Algorithm (NPASA) designed to solve nonlinear programs. In particular, we establish local quadratic convergence of the primal iterates and global error estimator for NPASA under reasonable assumptions. Additionally, under the same set of assumptions we prove that only phase two of NPASA is execut…
▽ More
In this paper, we provide local convergence analysis for the two phase Nonlinear Polyhedral Active Set Algorithm (NPASA) designed to solve nonlinear programs. In particular, we establish local quadratic convergence of the primal iterates and global error estimator for NPASA under reasonable assumptions. Additionally, under the same set of assumptions we prove that only phase two of NPASA is executed after finitely many iterations. This paper is companion to a paper that provides motivation and global convergence analysis for NPASA.
△ Less
Submitted 15 July, 2021;
originally announced July 2021.
-
The Switch Point Algorithm
Authors:
Mahya Aghaee,
William W. Hager
Abstract:
The Switch Point Algorithm is a new approach for solving optimal control problems whose solutions are either singular or bang-bang or both singular and bang-bang, and which possess a finite number of jump discontinuities in an optimal control at the points in time where the solution structure changes. Problems in this class can often be reduced to an optimization over the switching points. Formula…
▽ More
The Switch Point Algorithm is a new approach for solving optimal control problems whose solutions are either singular or bang-bang or both singular and bang-bang, and which possess a finite number of jump discontinuities in an optimal control at the points in time where the solution structure changes. Problems in this class can often be reduced to an optimization over the switching points. Formulas are derived for the derivative of the objective with respect to the switch points, the initial costate, and the terminal time. All these derivatives can be computed simultaneously in just one integration of the state and costate dynamics. Hence, gradient-based unconstrained optimization techniques, including the conjugate gradient method or quasi-Newton methods, can be used to compute an optimal control. The performance of the algorithm is illustrated using test problems with known solutions and comparisons with other algorithms from the literature.
△ Less
Submitted 26 June, 2021; v1 submitted 19 November, 2020;
originally announced November 2020.
-
A Newton-Type Active Set Method for Nonlinear Optimization with Polyhedral Constraints
Authors:
William W. Hager,
Davoud Ataee Tarzanagh
Abstract:
A Newton-type active set algorithm for large-scale minimization subject to polyhedral constraints is proposed. The algorithm consists of a gradient projection step, a second-order Newton-type step in the null space of the constraint matrix, and a set of rules for branching between the two steps. We show that the proposed method asymptotically takes the Newton step when the active constraints are l…
▽ More
A Newton-type active set algorithm for large-scale minimization subject to polyhedral constraints is proposed. The algorithm consists of a gradient projection step, a second-order Newton-type step in the null space of the constraint matrix, and a set of rules for branching between the two steps. We show that the proposed method asymptotically takes the Newton step when the active constraints are linearly independent and a strong second-order sufficient optimality condition holds. We also show that the method has a quadratic rate of convergence under standard conditions. Numerical experiments are presented illustrating the performance of the algorithm on the CUTEst and on a specific class of problems for which finding second-order stationary points is critical.
△ Less
Submitted 9 January, 2021; v1 submitted 2 November, 2020;
originally announced November 2020.
-
An Inexact Accelerated Stochastic ADMM for Separable Convex Optimization
Authors:
Jianchao Bai,
William W. Hager,
Hongchao Zhang
Abstract:
An inexact accelerated stochastic Alternating Direction Method of Multipliers (AS-ADMM) scheme is developed for solving structured separable convex optimization problems with linear constraints. The objective function is the sum of a possibly nonsmooth convex function and a smooth function which is an average of many component convex functions. Problems having this structure often arise in machine…
▽ More
An inexact accelerated stochastic Alternating Direction Method of Multipliers (AS-ADMM) scheme is developed for solving structured separable convex optimization problems with linear constraints. The objective function is the sum of a possibly nonsmooth convex function and a smooth function which is an average of many component convex functions. Problems having this structure often arise in machine learning and data mining applications. AS-ADMM combines the ideas of both ADMM and the stochastic gradient methods using variance reduction techniques. One of the ADMM subproblems employs a linearization technique while a similar linearization could be introduced for the other subproblem. For a specified choice of the algorithm parameters, it is shown that the objective error and the constraint violation are $\mathcal{O}(1/k)$ relative to the number of outer iterations $k$. Under a strong convexity assumption, the expected iterate error converges to zero linearly. A linearized variant of AS-ADMM and incremental sampling strategies are also discussed. Numerical experiments with both stochastic and deterministic ADMM algorithms show that AS-ADMM can be particularly effective for structured optimization arising in big data applications.
△ Less
Submitted 23 October, 2020;
originally announced October 2020.
-
Solving Singular Control Problems in Mathematical Biology, Using PASA
Authors:
Summer Atkins,
Mahya Aghaee,
Maia Martcheva,
William Hager
Abstract:
In this paper, we will demonstrate how to use a nonlinear polyhedral constrained optimization solver called the Polyhedral Active Set Algorithm (PASA) for solving a general singular control problem. We present methods of discretizing a general optimal control problem that involves the use of the gradient of the Lagrangian for computing the gradient of the cost functional so that PASA can be applie…
▽ More
In this paper, we will demonstrate how to use a nonlinear polyhedral constrained optimization solver called the Polyhedral Active Set Algorithm (PASA) for solving a general singular control problem. We present methods of discretizing a general optimal control problem that involves the use of the gradient of the Lagrangian for computing the gradient of the cost functional so that PASA can be applied. When a numerical solution contains artifacts that resemble "chattering'', a phenomenon where the control oscillates wildly along the singular region, we recommend a method of regularizing the singular control problem by adding a term to the cost functional that measures a scalar multiple of the total variation of the control, where the scalar is viewed as a tuning parameter. We then demonstrate PASA's performance on three singular control problems that give rise to different applications of mathematical biology. We also provide some exposition on the heuristics that we use in determining an appropriate size for the tuning parameter.
△ Less
Submitted 13 October, 2020;
originally announced October 2020.
-
Mesh Refinement Method for Solving Optimal Control Problems with Nonsmooth Solutions Using Jump Function Approximations
Authors:
Alexander T. Miller,
WIlliam W. Hager,
Anil V. Rao
Abstract:
A mesh refinement method is described for solving optimal control problems using Legendre-Gauss-Radau collocation. The method detects discontinuities in the control solution by employing an edge detection scheme based on jump function approximations. When discontinuities are identified, the mesh is refined with a targeted $h$-refinement approach whereby the discontinuity locations are bracketed wi…
▽ More
A mesh refinement method is described for solving optimal control problems using Legendre-Gauss-Radau collocation. The method detects discontinuities in the control solution by employing an edge detection scheme based on jump function approximations. When discontinuities are identified, the mesh is refined with a targeted $h$-refinement approach whereby the discontinuity locations are bracketed with mesh points. The remaining smooth portions of the mesh are refined using previously developed techniques. The method is demonstrated on two examples, and results indicate that the method solves optimal control problems with discontinuous control solutions using fewer mesh refinement iterations and less computation time when compared with previously developed methods.
△ Less
Submitted 25 March, 2020;
originally announced March 2020.
-
Convergence rates for an inexact ADMM applied to separable convex optimization
Authors:
William W. Hager,
Hongchao Zhang
Abstract:
Convergence rates are established for an inexact accelerated alternating direction method of multipliers (I-ADMM) for general separable convex optimization with a linear constraint. Both ergodic and non-ergodic iterates are analyzed. Relative to the iteration number k, the convergence rate is O(1/k) in a convex setting and O(1/k^2) in a strongly convex setting. When an error bound condition holds,…
▽ More
Convergence rates are established for an inexact accelerated alternating direction method of multipliers (I-ADMM) for general separable convex optimization with a linear constraint. Both ergodic and non-ergodic iterates are analyzed. Relative to the iteration number k, the convergence rate is O(1/k) in a convex setting and O(1/k^2) in a strongly convex setting. When an error bound condition holds, the algorithm is 2-step linearly convergent. The I-ADMM is designed so that the accuracy of the inexact iteration preserves the global convergence rates of the exact iteration, leading to better numerical performance in the test problems.
△ Less
Submitted 8 June, 2020; v1 submitted 6 January, 2020;
originally announced January 2020.
-
Modified Legendre-Gauss-Radau Collocation Method for Solving Optimal Control Problems with Nonsmooth Solutions
Authors:
Joseph D. Eide,
William W. Hager,
Anil V. Rao
Abstract:
A new method is developed for solving optimal control problems whose solutions are nonsmooth. The method developed in this paper employs a modified form of the Legendre-Gauss-Radau orthogonal direct collocation method. This modified Legendre-Gauss-Radau method adds two variables and two constraints at the end of a mesh interval when compared with a previously developed standard Legendre-Gauss-Rada…
▽ More
A new method is developed for solving optimal control problems whose solutions are nonsmooth. The method developed in this paper employs a modified form of the Legendre-Gauss-Radau orthogonal direct collocation method. This modified Legendre-Gauss-Radau method adds two variables and two constraints at the end of a mesh interval when compared with a previously developed standard Legendre-Gauss-Radau collocation method. The two additional variables are the time at the interface between two mesh intervals and the control at the end of each mesh interval. The two additional constraints are a collocation condition for those differential equations that depend upon the control and an inequality constraint on the control at the endpoint of each mesh interval. The additional constraints modify the search space of the nonlinear programming problem such that an accurate approximation to the location of the nonsmoothness is obtained. The transformed adjoint system of the modified Legendre-Gauss-Radau method is then developed. Using this transformed adjoint system, a method is developed to transform the Lagrange multipliers of the nonlinear programming problem to the costate of the optimal control problem. Furthermore, it is shown that the costate estimate satisfies one of the Weierstrass-Erdmann optimality conditions. Finally, the method developed in this paper is demonstrated on an example whose solution is nonsmooth.
△ Less
Submitted 8 November, 2020; v1 submitted 7 September, 2019;
originally announced September 2019.
-
Mesh Refinement Method for Solving Bang-Bang Optimal Control Problems Using Direct Collocation
Authors:
Yunus M. Agamawi,
William W. Hager,
Anil V. Rao
Abstract:
A mesh refinement method is developed for solving bang-bang optimal control problems using direct collocation. The method starts by finding a solution on a coarse mesh. Using this initial solution, the method then determines automatically if the Hamiltonian is linear with respect to the control, and, if so, estimates the locations of the discontinuities in the control. The switch times are estimat…
▽ More
A mesh refinement method is developed for solving bang-bang optimal control problems using direct collocation. The method starts by finding a solution on a coarse mesh. Using this initial solution, the method then determines automatically if the Hamiltonian is linear with respect to the control, and, if so, estimates the locations of the discontinuities in the control. The switch times are estimated by determining the roots of the switching functions, where the switching functions are determined using estimates of the state and costate obtained from the collocation method. The accuracy of the switch times is then improved on subsequent meshes by dividing the original optimal control problem into multiple domains and including variables that define the locations of the switch times. While in principle any collocation method can be used, in this research the previously developed Legendre-Gauss-Radau collocation method is employed because it provides an accurate approximation of the costate which in turn improves the approximation of the switching functions. The method of this paper is designed to be used with a previously developed mesh refinement method in order to accurately approximate the solution in segments where the solution is smooth. The method is demonstrated on three examples where it is shown to accurately determine the switching structure of a bang-bang optimal control problem. When compared with previously developed mesh refinement methods, the results demonstrate that the method developed in this paper improves computational efficiency when solving bang-bang optimal control problems.
△ Less
Submitted 30 May, 2019; v1 submitted 28 May, 2019;
originally announced May 2019.
-
Convergence rate for a Gauss collocation method applied to constrained optimal control
Authors:
William W. Hager,
Jun Liu,
Subhashree Mohapatra,
Anil V. Rao,
Xiang-Sheng Wang
Abstract:
A local convergence rate is established for a Gauss orthogonal collocation method applied to optimal control problems with control constraints. If the Hamiltonian possesses a strong convexity property, then the theory yields convergence for problems whose optimal state and costate possess two square integrable derivatives. The convergence theory is based on a stability result for the sup-norm chan…
▽ More
A local convergence rate is established for a Gauss orthogonal collocation method applied to optimal control problems with control constraints. If the Hamiltonian possesses a strong convexity property, then the theory yields convergence for problems whose optimal state and costate possess two square integrable derivatives. The convergence theory is based on a stability result for the sup-norm change in the solution of a variational inequality relative to a 2-norm perturbation, and on a Sobolev space bound for the error in interpolation at the Gauss quadrature points and the additional point -1. The tightness of the convergence theory is examined using a numerical example.
△ Less
Submitted 18 December, 2017; v1 submitted 10 July, 2016;
originally announced July 2016.
-
An Active Set Algorithm for Nonlinear Optimization with Polyhedral Constraints
Authors:
William W. Hager,
Hongchao Zhang
Abstract:
A polyhedral active set algorithm PASA is developed for solving a nonlinear optimization problem whose feasible set is a polyhedron. Phase one of the algorithm is the gradient projection method, while phase two is any algorithm for solving a linearly constrained optimization problem. Rules are provided for branching between the two phases. Global convergence to a stationary point is established, w…
▽ More
A polyhedral active set algorithm PASA is developed for solving a nonlinear optimization problem whose feasible set is a polyhedron. Phase one of the algorithm is the gradient projection method, while phase two is any algorithm for solving a linearly constrained optimization problem. Rules are provided for branching between the two phases. Global convergence to a stationary point is established, while asymptotically PASA performs only phase two when either a nondegeneracy assumption holds, or the active constraints are linearly independent and a strong second-order sufficient optimality condition holds.
△ Less
Submitted 6 June, 2016;
originally announced June 2016.
-
Convergence Rate for a Radau hp Collocation Method Applied to Constrained Optimal Control
Authors:
William W. Hager,
Hongyan Hou,
Subhashree Mohapatra,
Anil V. Rao
Abstract:
For unconstrained control problems, a local convergence rate is established for an $hp$-method based on collocation at the Radau quadrature points in each mesh interval of the discretization. If the continuous problem has a sufficiently smooth solution and the Hamiltonian satisfies a strong convexity condition, then the discrete problem possesses a local minimizer in a neighborhood of the continuo…
▽ More
For unconstrained control problems, a local convergence rate is established for an $hp$-method based on collocation at the Radau quadrature points in each mesh interval of the discretization. If the continuous problem has a sufficiently smooth solution and the Hamiltonian satisfies a strong convexity condition, then the discrete problem possesses a local minimizer in a neighborhood of the continuous solution, and as either the number of collocation points or the number of mesh intervals increase, the discrete solution convergences to the continuous solution in the sup-norm. The convergence is exponentially fast with respect to the degree of the polynomials on each mesh interval, while the error is bounded by a polynomial in the mesh spacing. An advantage of the $hp$-scheme over global polynomials is that there is a convergence guarantee when the mesh is sufficiently small, while the convergence result for global polynomials requires that a norm of the linearized dynamics is sufficiently small. Numerical examples explore the convergence theory.
△ Less
Submitted 12 September, 2018; v1 submitted 6 May, 2016;
originally announced May 2016.
-
Inexact alternating direction multiplier methods for separable convex optimization
Authors:
William W. Hager,
Hongchao Zhang
Abstract:
Inexact alternating direction multiplier methods (ADMMs) are developed for solving general separable convex optimization problems with a linear constraint and with an objective that is the sum of smooth and nonsmooth terms. The approach involves linearized subproblems, a back substitution step, and either gradient or accelerated gradient techniques. Global convergence is established. The methods a…
▽ More
Inexact alternating direction multiplier methods (ADMMs) are developed for solving general separable convex optimization problems with a linear constraint and with an objective that is the sum of smooth and nonsmooth terms. The approach involves linearized subproblems, a back substitution step, and either gradient or accelerated gradient techniques. Global convergence is established. The methods are particularly useful when the ADMM subproblems do not have closed form solution or when the solution of the subproblems is expensive. Numerical experiments based on image reconstruction problems show the effectiveness of the proposed methods.
△ Less
Submitted 8 April, 2016;
originally announced April 2016.
-
A Decentralized Multi-block ADMM for Demand-side Primary Frequency Control using Local Frequency Measurements
Authors:
Jonathan Brooks,
William Hager,
Jiajie Zhu
Abstract:
We consider demand-side primary frequency control in the power grid provided by smart and flexible loads: loads change consumption to match generation and help the grid while minimizing disutility for consumers incurred by consumption changes. The dual formulation of this problem has been solved previously by Zhao et al. in a decentralized manner for consumer disutilities that are twice continuous…
▽ More
We consider demand-side primary frequency control in the power grid provided by smart and flexible loads: loads change consumption to match generation and help the grid while minimizing disutility for consumers incurred by consumption changes. The dual formulation of this problem has been solved previously by Zhao et al. in a decentralized manner for consumer disutilities that are twice continuously differentiable with respect to consumption changes. In this work, we propose a decentralized multi-block alternating-direction-method-of-multipliers (DM-ADMM) algorithm to solve this problem. In contrast to the dual ascent algorithm of Zhao et al., the proposed DM-ADMM algorithm does not require the disutilities to be continuously differentiable; this allows disutility functions that model consumer behavior that may be quite common. In this work, we prove convergence of the DM-ADMM algorithm in the deterministic setting (i.e., when loads may estimate the consumption-generation mismatch from frequency measurements exactly). We test the performance of the DM-ADMM algorithm in simulations, and we compare (when applicable) with the previously proposed solution for the dual formulation. We also present numerical results for a previously proposed ADMM algorithm, whose results were not previously reported.
△ Less
Submitted 6 April, 2019; v1 submitted 28 September, 2015;
originally announced September 2015.
-
Convergence rate for a Radau collocation method applied to unconstrained optimal control
Authors:
William W. Hager,
Hongyan Hou,
Anil V. Rao
Abstract:
A local convergence rate is established for an orthogonal collocation method based on Radau quadrature applied to an unconstrained optimal control problem. If the continuous problem has a sufficiently smooth solution and the Hamiltonian satisfies a strong convexity condition, then the discrete problem possesses a local minimizer in a neighborhood of the continuous solution, and as the number of co…
▽ More
A local convergence rate is established for an orthogonal collocation method based on Radau quadrature applied to an unconstrained optimal control problem. If the continuous problem has a sufficiently smooth solution and the Hamiltonian satisfies a strong convexity condition, then the discrete problem possesses a local minimizer in a neighborhood of the continuous solution, and as the number of collocation points increases, the discrete solution convergences exponentially fast in the sup-norm to the continuous solution. An earlier paper analyzes an orthogonal collocation method based on Gauss quadrature, where neither end point of the problem domain is a collocation point. For the Radau quadrature scheme, one end point is a collocation point.
△ Less
Submitted 12 September, 2015; v1 submitted 15 August, 2015;
originally announced August 2015.
-
Lebesgue Constants Arising in a Class of Collocation Methods
Authors:
William W. Hager,
Hongyan Hou,
Anil V. Rao
Abstract:
Estimates are obtained for the Lebesgue constants associated with the Gauss quadrature points on $(-1, +1)$ augmented by the point $-1$ and with the Radau quadrature points on either $(-1, +1]$ or $[-1, +1)$. It is shown that the Lebesgue constants are $O(\sqrt{N})$, where $N$ is the number of quadrature points. These point sets arise in the estimation of the residual associated with recently deve…
▽ More
Estimates are obtained for the Lebesgue constants associated with the Gauss quadrature points on $(-1, +1)$ augmented by the point $-1$ and with the Radau quadrature points on either $(-1, +1]$ or $[-1, +1)$. It is shown that the Lebesgue constants are $O(\sqrt{N})$, where $N$ is the number of quadrature points. These point sets arise in the estimation of the residual associated with recently developed orthogonal collocation schemes for optimal control problems. For problems with smooth solutions, the estimates for the Lebesgue constants can imply an exponential decay of the residual in the collocated problem as a function of the number of quadrature points.
△ Less
Submitted 14 September, 2015; v1 submitted 29 July, 2015;
originally announced July 2015.
-
Convergence rate for a Gauss collocation method applied to unconstrained optimal control
Authors:
William W. Hager,
Hongyan Hou,
Anil V. Rao
Abstract:
A local convergence rate is established for an orthogonal collocation method based on Gauss quadrature applied to an unconstrained optimal control problem. If the continuous problem has a sufficiently smooth solution and the Hamiltonian satisfies a strong convexity condition, then the discrete problem possesses a local minimizer in a neighborhood of the continuous solution, and as the number of co…
▽ More
A local convergence rate is established for an orthogonal collocation method based on Gauss quadrature applied to an unconstrained optimal control problem. If the continuous problem has a sufficiently smooth solution and the Hamiltonian satisfies a strong convexity condition, then the discrete problem possesses a local minimizer in a neighborhood of the continuous solution, and as the number of collocation points increases, the discrete solution convergences exponentially fast in the sup-norm to the continuous solution. This is the first convergence rate result for an orthogonal collocation method based on global polynomials applied to an optimal control problem.
△ Less
Submitted 16 August, 2015; v1 submitted 29 July, 2015;
originally announced July 2015.
-
Pointfree pointwise suprema in unital archimedean $\ell$-groups
Authors:
Richard N. Ball,
Anthony W. Hager,
Joanne Walters-Wayland
Abstract:
We generalize the concept of the pointwise supremum of real-valued functions to the pointfree setting. The concept itself admits a direct and intuitive formulation which makes no mention of points. But our aim here is to investigate pointwise suprema of subsets of $\mathcal{R}L$, the family of continuous real valued functions on a locale, or pointfree space. Our setting is the category…
▽ More
We generalize the concept of the pointwise supremum of real-valued functions to the pointfree setting. The concept itself admits a direct and intuitive formulation which makes no mention of points. But our aim here is to investigate pointwise suprema of subsets of $\mathcal{R}L$, the family of continuous real valued functions on a locale, or pointfree space. Our setting is the category $\mathbf{W}$ of archimedean lattice-ordered groups ($\ell$-groups) with designated weak order unit, with morphisms which preserve the group and lattice operations and take units to units.
A main result is the appropriate analog of the Nakano-Stone Theorem: a (completely regular) locale $L$ has the feature that $\mathcal{R}L$ is conditionally pointwise complete ($σ$-complete), i.e., every bounded (countable) family from $\mathcal{R}L$ has a pointwise supremum in $\mathcal{R}L$, iff $L $ is boolean (a $P$-locale).
We adopt a maximally broad definition of unconditional pointwise completeness ($σ$-completeness): a divisible $\mathbf{W}$-object $G$ is pointwise complete ($σ$-complete) if it contains a pointwise supremum for every subset which has a supremum in any extension. We show that the pointwise complete ($σ$-complete) $\mathbf{W}$-objects are those of the form $\mathcal{R}L$ for $L$ a boolean locale ($P$-locale). Finally, we show that a $\mathbf{W}$-object $G$ is pointwise $σ$-complete iff it is epicomplete.
△ Less
Submitted 12 November, 2014;
originally announced November 2014.
-
A Multilevel Bilinear Programming Algorithm For the Vertex Separator Problem
Authors:
William W. Hager,
James T. Hungerford,
Ilya Safro
Abstract:
The Vertex Separator Problem for a graph is to find the smallest collection of vertices whose removal breaks the graph into two disconnected subsets that satisfy specified size constraints. In the paper 10.1016/j.ejor.2014.05.042, the Vertex Separator Problem was formulated as a continuous (non-concave/non-convex) bilinear quadratic program. In this paper, we develop a more general continuous bili…
▽ More
The Vertex Separator Problem for a graph is to find the smallest collection of vertices whose removal breaks the graph into two disconnected subsets that satisfy specified size constraints. In the paper 10.1016/j.ejor.2014.05.042, the Vertex Separator Problem was formulated as a continuous (non-concave/non-convex) bilinear quadratic program. In this paper, we develop a more general continuous bilinear program which incorporates vertex weights, and which applies to the coarse graphs that are generated in a multilevel compression of the original Vertex Separator Problem. A Mountain Climbing Algorithm is used to find a stationary point of the continuous bilinear quadratic program, while second-order optimality conditions and perturbation techniques are used to escape from either a stationary point or a local maximizer. The algorithms for solving the continuous bilinear program are employed during the solution and refinement phases in a multilevel scheme. Computational results and comparisons demonstrate the advantage of the proposed algorithm.
△ Less
Submitted 17 July, 2016; v1 submitted 17 October, 2014;
originally announced October 2014.
-
Projection Algorithms for Non-Convex Minimization with Application to Sparse Principal Component Analysis
Authors:
William W. Hager,
Dzung T. Phan,
Jia-Jie Zhu
Abstract:
We consider concave minimization problems over non-convex sets.Optimization problems with this structure arise in sparse principal component analysis. We analyze both a gradient projection algorithm and an approximate Newton algorithm where the Hessian approximation is a multiple of the identity. Convergence results are established. In numerical experiments arising in sparse principal component an…
▽ More
We consider concave minimization problems over non-convex sets.Optimization problems with this structure arise in sparse principal component analysis. We analyze both a gradient projection algorithm and an approximate Newton algorithm where the Hessian approximation is a multiple of the identity. Convergence results are established. In numerical experiments arising in sparse principal component analysis, it is seen that the performance of the gradient projection algorithm is very similar to that of the truncated power method and the generalized power method. In some cases, the approximate Newton algorithm with a Barzilai-Borwein (BB) Hessian approximation can be substantially faster than the other algorithms, and can converge to a better solution.
△ Less
Submitted 6 April, 2019; v1 submitted 15 April, 2014;
originally announced April 2014.
-
A Continuous Refinement Strategy for the Multilevel Computation of Vertex Separators
Authors:
William Hager,
James Hungerford,
Ilya Safro
Abstract:
The Vertex Separator Problem (VSP) on a graph is the problem of finding the smallest collection of vertices whose removal separates the graph into two disjoint subsets of roughly equal size. Recently, Hager and Hungerford [1] developed a continuous bilinear programming formulation of the VSP. In this paper, we reinforce the bilinear programming approach with a multilevel scheme for learning the st…
▽ More
The Vertex Separator Problem (VSP) on a graph is the problem of finding the smallest collection of vertices whose removal separates the graph into two disjoint subsets of roughly equal size. Recently, Hager and Hungerford [1] developed a continuous bilinear programming formulation of the VSP. In this paper, we reinforce the bilinear programming approach with a multilevel scheme for learning the structure of the graph.
△ Less
Submitted 22 November, 2013;
originally announced November 2013.
-
An ellipsoidal branch and bound algorithm for global optimization
Authors:
William Hager,
Dzung Phan
Abstract:
A branch and bound algorithm is developed for global optimization. Branching in the algorithm is accomplished by subdividing the feasible set using ellipses. Lower bounds are obtained by replacing the concave part of the objective function by an affine underestimate. A ball approximation algorithm, obtained by generalizing of a scheme of Lin and Han, is used to solve the convex relaxation of the…
▽ More
A branch and bound algorithm is developed for global optimization. Branching in the algorithm is accomplished by subdividing the feasible set using ellipses. Lower bounds are obtained by replacing the concave part of the objective function by an affine underestimate. A ball approximation algorithm, obtained by generalizing of a scheme of Lin and Han, is used to solve the convex relaxation of the original problem. The ball approximation algorithm is compared to SEDUMI as well as to gradient projection algorithms using randomly generated test problems with a quadratic objective and ellipsoidal constraints.
△ Less
Submitted 9 December, 2009;
originally announced December 2009.
-
An exact algorithm for graph partitioning
Authors:
William Hager,
Dzung Phan,
Hongchao Zhang
Abstract:
An exact algorithm is presented for solving edge weighted graph partitioning problems. The algorithm is based on a branch and bound method applied to a continuous quadratic programming formulation of the problem. Lower bounds are obtained by decomposing the objective function into convex and concave parts and replacing the concave part by an affine underestimate. It is shown that the best affine…
▽ More
An exact algorithm is presented for solving edge weighted graph partitioning problems. The algorithm is based on a branch and bound method applied to a continuous quadratic programming formulation of the problem. Lower bounds are obtained by decomposing the objective function into convex and concave parts and replacing the concave part by an affine underestimate. It is shown that the best affine underestimate can be expressed in terms of the center and the radius of the smallest sphere containing the feasible set. The concave term is obtained either by a constant diagonal shift associated with the smallest eigenvalue of the objective function Hessian, or by a diagonal shift obtained by solving a semidefinite programming problem. Numerical results show that the proposed algorithm is competitive with state-of-the-art graph partitioning codes.
△ Less
Submitted 8 December, 2009;
originally announced December 2009.
-
Gradient-based methods for sparse recovery
Authors:
William Hager,
Dzung Phan,
Hongchao Zhang
Abstract:
The convergence rate is analyzed for the SpaSRA algorithm (Sparse Reconstruction by Separable Approximation) for minimizing a sum $f (\m{x}) + ψ(\m{x})$ where $f$ is smooth and $ψ$ is convex, but possibly nonsmooth. It is shown that if $f$ is convex, then the error in the objective function at iteration $k$, for $k$ sufficiently large, is bounded by $a/(b+k)$ for suitable choices of $a$ and $b$.…
▽ More
The convergence rate is analyzed for the SpaSRA algorithm (Sparse Reconstruction by Separable Approximation) for minimizing a sum $f (\m{x}) + ψ(\m{x})$ where $f$ is smooth and $ψ$ is convex, but possibly nonsmooth. It is shown that if $f$ is convex, then the error in the objective function at iteration $k$, for $k$ sufficiently large, is bounded by $a/(b+k)$ for suitable choices of $a$ and $b$. Moreover, if the objective function is strongly convex, then the convergence is $R$-linear. An improved version of the algorithm based on a cycle version of the BB iteration and an adaptive line search is given. The performance of the algorithm is investigated using applications in the areas of signal processing and image reconstruction.
△ Less
Submitted 8 December, 2009;
originally announced December 2009.
-
The moduli space of complex two dimensional associative algebras
Authors:
Derek Bodin,
Chris DeCleene,
William Hager,
Carolyn Otto,
Michael Penkava,
Mitch Phillipson,
Ryan Steinbach,
Eric Weber
Abstract:
In this paper, we study moduli spaces of 2-dimensional complex associative algebras. We give a complete calculation of the cohomology of every element in the moduli space, as well as compute their versal deformations.
In this paper, we study moduli spaces of 2-dimensional complex associative algebras. We give a complete calculation of the cohomology of every element in the moduli space, as well as compute their versal deformations.
△ Less
Submitted 28 March, 2009;
originally announced March 2009.
-
The moduli space of $1|1$-dimensional complex associative algebras
Authors:
Derek Bodin,
Christopher DeCleene,
William Hager,
Carolyn Otto,
Michael Penkava,
Mitch Phillipson,
Ryan Steinbach,
Eric Weber
Abstract:
In this paper, we study the moduli space of $1|1$-dimensional complex associative algebras. We give a complete calculation of the cohomology of every element in the moduli space, as well as compute their versal deformations.
In this paper, we study the moduli space of $1|1$-dimensional complex associative algebras. We give a complete calculation of the cohomology of every element in the moduli space, as well as compute their versal deformations.
△ Less
Submitted 28 March, 2009;
originally announced March 2009.
-
Multilevel domain decomposition for electronic structure calculations
Authors:
M. Barrault,
E. Cances,
W. W. Hager,
C. Le Bris
Abstract:
We introduce a new multilevel domain decomposition method (MDD) for electronic structure calculations within semi-empirical and Density Functional Theory (DFT) frameworks. This method iterates between local fine solvers and global coarse solvers, in the spirit of domain decomposition methods.
We introduce a new multilevel domain decomposition method (MDD) for electronic structure calculations within semi-empirical and Density Functional Theory (DFT) frameworks. This method iterates between local fine solvers and global coarse solvers, in the spirit of domain decomposition methods.
△ Less
Submitted 7 November, 2005;
originally announced November 2005.
