Background results for robust minmax control
of linear dynamical systems

The purpose of this note is to summarize the arguments required to derive the results appearing in robust minmax control of linear dynamical systems using a quadratic stage cost. The main results required in robust minmax control are Corollary 19 and Proposition 20. Moreover, the solution to the trust-region problem given in Proposition 15 and Lemma 16 may be of more general interest.

Linear algebra

We assume throughout that the parameters $D\in\mathbb{R}^{n\times n}\geq 0$, $A\in\mathbb{R}^{m\times n},b\in\mathbb{R}^{m},d\in\mathbb{R}^{n}$ or $d\in\mathbb{R}^{n+m}$. Let $A^{+}\in\mathbb{R}^{n\times m}$ denote the pseudoinverse of matrix $A\in\mathbb{R}^{m\times n}$. Let $N(A)$ and $R(A)$ denoted the null space and range space of matrix $A$, respectively. We will also make use of the singular value decomposition (SVD) of $A$ given by

$$A=\begin{bmatrix}U_{1}&U_{2}\end{bmatrix}\begin{bmatrix}\Sigma_{r}&0\\ 0&0\end{bmatrix}\begin{bmatrix}V_{1}^{\prime}\\ V_{2}^{\prime}\end{bmatrix}=U_{1}\Sigma_{r}V_{1}^{\prime}$$ (1)

and $r$ is the rank of $A$. The properties of the SVD and the fundamental theorem of linear algebra imply that the orthonormal columns of $U_{1}$ and $U_{2}$ are bases for $R(A)$ and $N(A^{\prime})$, respectively, and the orthonormal columns of $V_{1}$ and $V_{2}$ are bases for $R(A^{\prime})$ and $N(A)$, respectively. We also have that $A^{+}=V_{1}\Sigma_{r}^{-1}U_{1}^{\prime}$.

First, we require solutions to linear algebra problems when such solutions exist.

Proposition 1 (Solving linear algebra problems.).

Consider the linear algebra problem

$$Ax=b$$

1. A solution exists if and only if $b\in R(A)$.

2. For $b\in R(A)$, the solution (set of solutions) is given by

   $$x^{0}\in A^{+}b+N(A)$$ (2)

Proof.

By definition of range, if $b\notin R(A)$ there is no $x$ such that $Ax=b$, and if $b\in R(A)$, there is an $x$ such that $Ax=b$, which is the same as the existence condition. For $b\in R(A)$, let $z\in\mathbb{R}^{n}$ denote a value so that $Az=b$, and let $q$ be an arbitrary element in $N(A)$ so $x^{0}=A^{+}b+q$. To show Eq. 2 are solutions, note that

$$Ax^{0}=A(A^{+}b+q)=AA^{+}Az=Az=b$$

where we have used the definition of the null space and one of the pseudoinverse’s defining properties, $AA^{+}A=A$. To show that Eq. 2 are all solutions, let $x^{\prime}$ denote a solution. We then have $A(x^{\prime}-A^{+}b)=b-b=0$, so $x^{\prime}-A^{+}b\in N(A)$ or $x^{\prime}\in A^{+}b+N(A)$. Since $x^{\prime}$ is an arbitrary solution, Eq. 2 gives all solutions. ∎

Note that if one is interested in deriving Eq. 2 rather than establishing that it is correct as we did here, use the two orthogonal coordinate systems provided by the SVD of $A$, and let $x=V\alpha$, $b=U\beta$, and solve that simpler decoupled linear algebra problem for $\alpha^{0}$ as a function of $\beta$, and convert back to $x^{0}$ in terms of $b$.

If $b\notin R(A)$, $x^{0}$ is still well-defined, but $Ax^{0}-b=(AA^{+}-I)b=-U_{2}U_{2}^{\prime}b\neq 0$. In this case, the $x^{0}$ given in Eq. 2 solves $\min_{x}\left|Ax-b\right|$ (least-squares solution), and achieves value $\left|Ax^{0}-b\right|=\left|U_{2}^{\prime}b\right|$.

Positive semidefinite matrices.

We say that a matrix $M\in\mathbb{R}^{n\times n}$ is positive semidefinite, denoted $M\geq 0$, if $M$ is symmetric and $x^{\prime}Mx\geq 0$ for all $x\in\mathbb{R}^{n}$.

Optimization

We shall appeal without proof to one theorem for existence of solutions to optimization problems, the Weierstrass (extreme value) theorem. It says that a continuous function on a closed and bounded set attains its min and max on the set. As we specialize to the results of interest in this note, next we consider convex, differentiable functions.

Definition 2 (Convex function).

A function $V:\mathbb{R}^{n}\rightarrow\mathbb{R}$ is convex if

$$V(\alpha u+(1-\alpha)v)\leq\alpha V(u)+(1-\alpha)V(v)$$ (3)

for all $u,v\in\mathbb{R}^{n}$ and $0\leq\alpha\leq 1$.

If the function $V$ is differentiable, then it is convex if and only if

$$V(v)\geq V(u)+(v-u)^{\prime}\frac{dV}{du}(u)$$ (4)

for all $u,v\in\mathbb{R}^{n}$. See Boyd and Vandenberghe (2004, pp.69–70) for a proof of this fact.

An immediate consequence of this global lower bound is that $u^{0}$ is a minimizer of $V$ if and only if $(dV/du)(u^{0})=0$.

Proposition 3.

A convex, differentiable function $V:\mathbb{R}^{n}\rightarrow\mathbb{R}$ has a minimizer $u^{0}$ if and only if $(dV/du)(u^{0})=0$.

Proof.

To establish sufficiency, assume $(dV/du)(u^{0})=0$; Eq. 4 then implies $V(v)\geq V(u^{0})$ for all $v\in\mathbb{R}^{n}$, and therefore $u^{0}$ is the minimizer of $V$.

To establish necessity, assume that $u^{0}$ is optimal but that, contrary to what is to be proven, $(dV/du)(u^{0})\neq 0$, and let $h=-(dV/du)(u^{0})$ so that the directional derivative satisfies

$$\lim_{\lambda\rightarrow 0^{+}}\frac{V(u^{0}+\lambda h)-V(u^{0})}{\lambda}=h^{\prime}\frac{dV}{du}(u^{0})=-\left|\frac{dV}{du}(u^{0})\right|^{2}$$

Given this limit, for every $\epsilon>0$ there exists $\delta(\epsilon)>0$ such that

$$\frac{V(u^{0}+\lambda h)-V(u^{0})}{\lambda}\leq-\left|\frac{dV}{du}(u^{0})\right|^{2}+\epsilon$$

for all $0<\lambda\leq\delta$. Choose $\epsilon=(1/2)\left|(dV/du)(u^{0})\right|^{2}>0$, and we have that

$$V(u^{0}+\lambda h)\leq V(u^{0})-(\lambda/2)\left|\frac{dV}{du}(u^{0})\right|^{2}$$

for $0<\lambda\leq\delta$. This inequality contradicts the optimality of $u^{0}$ and, therefore $(dV/du)(u^{0})=0$, which establishes necessity, and the proposition is proven. ∎

When considering robust control of linear dynamical systems with quadratic stage cost, quadratic functions play a central role. We have the following result about their convexity.

Proposition 4 (Convex quadratic functions).

The quadratic function $V(u)=(1/2)u^{\prime}Du+u^{\prime}d+c$ is convex if and only if $D\geq 0$.

Proof.

We establish that the quadratic term $f(u)\coloneqq u^{\prime}Du$ is convex by substituting $\alpha u+(1-\alpha)v$ into function $f$ and rearranging the terms

$$f(\alpha u+(1-\alpha)v)-\big{(}\alpha f(u)+(1-\alpha)f(v)\big{)}=-\alpha(1-\alpha)(u-v)^{\prime}D(u-v)$$

Since $-\alpha(1-\alpha)<0$ for $\alpha\in(0,1)$, we have that the right-hand side is less than or equal to zero for every $u,v\in\mathbb{R}^{n}$ if and only if $D\geq 0$, verifying (3) for the function $f$.

It is then straightforward to show that the linear function $u^{\prime}d$ and the constant function $c$ are both convex by directly verifying (3). It is also straightforward to establish that linear combinations of convex functions are convex by verifying (3), and, therefore the function $V$ is convex if and only if $D\geq 0$. ∎

The following optimization result for convex quadratic functions is then useful in the ensuing discussion.

Proposition 5 (Minimum of quadratic functions).

Consider the quadratic function $V(\cdot):\mathbb{R}^{n}\rightarrow\mathbb{R}$ with $D\in\mathbb{R}^{n\times n}\geq 0$

$$V(u)\coloneqq(1/2)u^{\prime}Du+u^{\prime}d$$

1. A solution to $\min_{u}V$ exists if and only if $d\in R(D)$.

2. For $d\in R(D)$, the minimizer and optimal value function are

   $$u^{0}\in-D^{+}d+N(D)\qquad V^{0}=-(1/2)d^{\prime}D^{+}d$$ (5)

   and $(d/du)V(u)=0$ at $u^{0}$.

Proof.

The function $V(u)$ is differentiable and convex (Proposition 4) so from Proposition 3, a solution exists if and only if the derivative is zero. Taking the derivative gives $(d/du)V(u)=Du+d$. From Proposition 1, $Du+d=0$ has a solution if and only if $d\in R(D)$ and the set of all solutions is $d^{0}=-D^{+}d+N(D)$, and evaluating $V$ at the solution gives $V(u^{0})=-(1/2)d^{\prime}D^{+}d$ establishing Eq. 5. ∎

For maximization problems, we can replace $D\geq 0$ with $D\leq 0$ and min with max.

Partitioned semidefinite matrices.

We make extensive use of partitioned matrices

$$M=\begin{bmatrix}M_{11}&M_{12}\\ M^{\prime}_{12}&M_{22}\end{bmatrix}$$

We have the following result for positive semidefinite partitioned matrices (Boyd and Vandenberghe, 2004, p.651).

Proposition 6 (Positive semidefinite partitioned matrices).

The matrix $M\geq 0$ if and only if $M_{11}\geq 0$, $M_{22}-M_{12}^{\prime}M_{11}^{+}M_{12}\geq 0$, and $R(M_{12})\subseteq R(M_{11})$.

Proof.

1. Forward implication. Define $V(x,y)\coloneqq(1/2)(x,y)^{\prime}M(x,y)$, and assume $M\geq 0$. Expanding $V$ using the partitioned matrix

   $$V(x,y) =(1/2)\begin{bmatrix}x\\ y\end{bmatrix}^{\prime}\begin{bmatrix}M_{11}&M_{12}\\ M^{\prime}_{12}&M_{22}\end{bmatrix}\begin{bmatrix}x\\ y\end{bmatrix}$$

   $$=(1/2)\big{(}x^{\prime}M_{11}x+2x^{\prime}M_{12}y+y^{\prime}M_{22}y\big{)}$$ (6)

   $$\geq 0,\quad\text{for all }(x,y)$$

   Setting $y=0$ in Eq. 6 implies that $M_{11}\geq 0$. Since $M_{11}\geq 0$, $V(x,y)$ is a differentiable, convex function of $x$ for any $y$. Therefore $\min_{x}V(x,y)$ has a solution for every $y$, and Proposition 5 then implies $M_{12}y\in R(M_{11})$ for every $y$, which is equivalent to $R(M_{12})\subseteq R(M_{11})$. Substituting the minimizer over $x$, $x^{0}=-M_{11}^{+}M_{12}y$ into $V$ gives

   $$V(x^{0},y)=(1/2)y^{\prime}(M_{22}-M^{\prime}_{12}M_{11}^{+}M_{12})y$$ (7)

   and since $V(x,y)\geq 0$ for all $(x,y)$, we have that $M_{22}-M^{\prime}_{12}M^{+}_{11}M_{12}\geq 0$, and the forward implication is established.

2. Reverse implication. Assume $M_{11}\geq 0$, $M_{22}-M^{\prime}_{12}M^{+}_{11}M_{12}\geq 0$, and $R(M_{12})\subseteq R(M_{11})$, and we establish that $M\geq 0$. For proof by contradiction, assume there exists an $(\overline{x},\overline{y})$ such that $(\overline{x},\overline{y})^{\prime}M(\overline{x},\overline{y})<0$. By Proposition 5, we know that $\min_{x}V(x,\overline{y})$ exists since $M_{11}\geq 0$ and $M_{12}\overline{y}\in R(M_{11})$, and it has value $V^{0}=V(x^{0},\overline{y})$ with $x^{0}=-M_{11}^{+}M_{12}\overline{y}$. Substituting this into $V$ gives $V^{0}=(1/2)\overline{y}^{\prime}(M_{22}-M^{\prime}_{12}M^{+}_{11}M_{12})\overline{y}\geq 0$ because matrix $M_{22}-M^{\prime}_{12}M^{+}_{11}M_{12}\geq 0$. By optimality of $x^{0}$, $V(x,\overline{y})\geq V^{0}\geq 0$ for all $x$. But that contradicts $V(\overline{x},\overline{y})<0$, and we conclude $M\geq 0$, and the proof is complete. ∎

Note that

$$\begin{bmatrix}M_{11}&M_{12}\\ M^{\prime}_{12}&M_{22}\end{bmatrix}\geq 0\quad\text{if and only if}\quad\begin{bmatrix}M_{22}&M^{\prime}_{12}\\ M_{12}&M_{11}\end{bmatrix}\geq 0$$

So we can also conclude that $M\geq 0$ if and only if $M_{11}\geq 0$, $M_{22}\geq 0$, $M_{22}-M^{\prime}_{12}M_{11}^{+}M_{12}\geq 0$, $M_{11}-M_{12}M_{22}^{+}M^{\prime}_{12}\geq 0$, $R(M_{12})\subseteq R(M_{11})$, and $R(M_{12}^{\prime})\subseteq R(M_{22})$. Note also that given the partitioning in $M$, we define

$$\tilde{M}_{11} \coloneqq M_{22}-M_{12}^{\prime}M_{11}^{+}M_{12}$$

$$\tilde{M}_{22} \coloneqq M_{11}-M_{12}M_{22}^{+}M^{\prime}_{12}$$ (8)

and $\tilde{M}_{11}$ is known as the Schur complement of $M_{11}$, and $\tilde{M}_{22}$ is known as the Schur complement of $M_{22}$.

Constraints and Lagrangians.

Next we require a standard optimization result for using a Lagrangian to reformulate a constrained minimization as an unconstrained minmax problem. The following result will be useful for this purpose. Let $U\subseteq\mathbb{R}^{n}$ be a nonempty compact set and $V(\cdot):U\rightarrow\mathbb{R}$ be a continuous function on $U$. Define the Lagrangian function $L(\cdot):U\times\mathbb{R}\rightarrow\mathbb{R}$ as

$$L(u,\lambda)=V(u)-\lambda\rho(u,U)$$ (9)

where $\rho(\cdot):\mathbb{R}^{n}\times U\rightarrow\mathbb{R}_{\geq 0}$ is any convenient continuous indicator function that evaluates to zero if and only if $u\in U$. Denote a minmax problem as

$$\mathop{\rm\hbox to0.0pt{\phantom{p}\hss}{inf}}_{u}\sup_{\lambda}L(u,\lambda)$$

When a solution to this problem exists, we define the optimal value $L^{*}$ and solution set $u^{*}$ as

$$L^{*}=\min_{u}\max_{\lambda}L(u,\lambda)\qquad u^{*}=\arg\min_{u}\max_{\lambda}L(u,\lambda)$$

It is convenient in the subsequent development to define the maximizer of the inner problem

$$\overline{\lambda}(u)\coloneqq\arg\max_{\lambda}L(u,\lambda),\quad u\in U$$

Proposition 7 (Constrained minimization and Lagrangian minmax).

Let $U\subseteq\mathbb{R}^{n}$ be a nonempty compact set and $V(\cdot):U\rightarrow\mathbb{R}$ be a continuous function on $U$, and $L(\cdot):U\times\mathbb{R}\rightarrow\mathbb{R}$ be defined as $L(u,\lambda)\coloneqq V(u)-\lambda\rho(u,U)$. Consider the constrained optimization problem

$$\inf_{u\in U}V(u)$$ (10)

and the (unconstrained) Lagrangian minmax problem

$$\mathop{\rm\hbox to0.0pt{\phantom{p}\hss}{inf}}_{u}\sup_{\lambda}L(u,\lambda)$$ (11)

1. Solutions to both problems exist.

2. Let $V^{0}$ be the solution and $u^{0}$ be the set of optimizers of $\min_{u\in U}V(u)$. Let $L^{*}$ be the solution and $u^{*}$ the set of optimizers of $\min_{u}\max_{\lambda}L(u,\lambda)$. Then

   $$V^{0}=L^{*}\qquad u^{0}=u^{*}\qquad\overline{\lambda}(u^{*})=\mathbb{R}$$

Proof.

The solution to Eq. 10 exists by the Weierstrass theorem. Denote the optimal value $V^{0}$ and solution set $u^{0}\subseteq U$ which satisfy $V(u^{0})=V^{0}$. We show that a solution to Eq. 11 also exists. Consider the inner supremum. From the definitions of functions $L$ and $\rho$, we conclude

$$\sup_{\lambda}L(u,\lambda)=\begin{cases}V(u),&\quad u\in U\\ +\infty,&\quad u\notin U\end{cases}$$

Then consider the outer infimum. We have that

$$L^{*}=\mathop{\rm\hbox to0.0pt{\phantom{p}\hss}{inf}}_{u}\sup_{\lambda}L(u,\lambda)=\inf_{u\in U}V(u)=\min_{u\in U}V(u)=V^{0}$$

So the solution to (11) exists with value $L^{*}=V^{0}$. Taking the argument gives

$$u^{*}\coloneqq\arg\mathop{\rm\hbox to0.0pt{\phantom{p}\hss}{inf}}_{u}\sup_{\lambda}L(u,\lambda)=\arg\min_{u\in U}V(u)=u^{0}$$

For the inner problem evaluated at $u^{*}$, we note that

$$\sup_{\lambda}L(u^{*},\lambda)=\sup_{\lambda}V(u^{0})=\max_{\lambda}V^{0}=V^{0}$$

Taking the argument then gives

$$\overline{\lambda}(u^{*})=\arg\sup_{\lambda}L(u^{*},\lambda)=\arg\max_{\lambda}V^{0}=\mathbb{R}$$

and the result is established. ∎

Minmax and Maxmin

More generally, we are interested in a function $V(u,w)$ $V:U\times W\rightarrow\mathbb{R}$ and the optimization problems

$$\mathop{\mathrm{inf}\vphantom{\mathrm{sup}}}_{u\in U}\sup_{w\in W}V(u,w)\qquad\sup_{w\in W}\mathop{\mathrm{inf}\vphantom{\mathrm{sup}}}_{u\in U}V(u,w)$$

We assume in the following that the $\inf$ and $\sup$ are achieved on the respective sets and replace them with $\min$ and $\max$.

Continuous functions.

Let’s start here. According to Wikipedia, von Neumann’s minimax theorem states (von Neumann, 1928)

Theorem 8 (Minimax Theorem).

Let $U\subset\mathbb{R}^{m}$ and $W\subset\mathbb{R}^{n}$ be compact convex sets. If $V:U\times W\to\mathbb{R}$ is a continuous function that is convex-concave, i.e., $V(\cdot,w):U\to\mathbb{R}$ is convex for all $w\in W$, and $V(u,\cdot):W\to\mathbb{R}$ is concave for all $u\in U$
Then we have that

$$\min_{u\in U}\max_{w\in W}V(u,w)=\max_{w\in W}\min_{u\in U}V(u,w)$$

Note that existence of min and max is guaranteed by compactness of $U,W$ (closed, bounded). Also note that the following holds for any continuous function $V$

$$\min_{u\in U}\max_{w\in W}V(u,w)\geq\max_{w\in W}\min_{u\in U}V(u,w)$$

This is often called weak duality. It’s easy to establish. We are regarding the switching of the order of min and max as a form of duality. (Think of observability and controllability as duals of each other.)

So when this inequality achieves equality, that’s often called strong duality. So the minimax theorem says that continuous functions that are convex-concave on compact sets satisfy strong duality. When strong duality is not achieved, we refer to the difference as the duality gap, which is positive due to weak duality

$$\min_{u\in U}\max_{w\in W}V(u,w)-\max_{w\in W}\min_{u\in U}V(u,w)>0$$

Saddle Points.

In characterizing solutions of these problems, it is useful to define a saddle point of the function $V(u,w)$.

Definition 9 (Saddle point).

The point (set) $(u^{*},w^{*})\subseteq U\times W$ is called a saddle point (set) of $V(\cdot)$ if

$$V(u^{*},w)\leq V(u^{*},w^{*})\leq V(u,w^{*})\quad\text{for all }u\in U,w\in W$$ (12)

Proposition 10 (Saddle-point theorem).

The point (set) $(u^{*},w^{*})\subseteq U\times W$ is a saddle point (set) of function $V(\cdot)$ if and only if strong duality holds and $(u^{*},w^{*})$ is a solution to the two problems

$$\min_{u\in U}\max_{w\in W}V(u,w)=\max_{w\in W}\min_{u\in U}V(u,w)=V(u^{*},w^{*})$$ (13)

$$u^{*}=\arg\min_{u\in U}\max_{w\in W}V(u,w)\qquad w^{*}=\arg\max_{w\in W}\min_{u\in U}V(u,w)$$ (14)

In the following development it is convenient to define the solutions to the minimization and maximization problems

$$\overline{V}(u)\coloneqq\max_{w\in W}V(u,w),\quad u\in U\qquad\underline{V}(w)\coloneqq\min_{u\in U}V(u,w),\quad w\in W$$ (15)

Note that Eq. 14 implies that $\max_{w\in W}\underline{V}(w)=\underline{V}(w^{*})$ and $\min_{u\in U}\overline{V}(u)=\overline{V}(u^{*})$.

Remark 11.

Note that Eq. 14 also implies that

$$\max_{w\in W}\min_{u\in U}V(u,w)=\min_{u\in U}V(u,w^{*})\qquad\min_{u\in U}\max_{w\in W}V(u,w)=\max_{w\in W}V(u^{*},w)$$ (16)

To establish this remark, note that

$$\max_{w\in W}\min_{u\in U}V(u,w)=\max_{w\in W}\underline{V}(w)=\underline{V}(w^{*})=\min_{u\in U}V(u,w^{*})$$

Similarly,

$$\min_{u\in U}\max_{w\in W}V(u,w)=\min_{u\in U}\overline{V}(u)=\overline{V}(u^{*})=\max_{w\in W}V(u^{*},w)$$

Next we prove Proposition 10

Proof.

First we establish that Eq. 14 implies Eq. 12. Note that by optimality, the first equality in Eq. 16, which is a consequence of assuming Eq. 14, implies that $V(u^{*},w^{*})\leq V(u,w^{*})$ for all $u\in U$, and the second implies that $V(u^{*},w^{*})\geq V(u^{*},w)$ for all $w\in W$. Taken together, these are Eq. 12.

Next we show that Eq. 12 implies Eq. 14. We know that the following holds by weak duality

$$\max_{w\in W}\min_{u\in U}V(u,w)\leq\min_{u\in U}\max_{w\in W}V(u,w)$$ (17)

So we wish to show that the reverse inequality also holds to establish strong duality, i.e., the first equality in Eq. 14. To that end note that from Eq. 12

$$V(u^{*},w)\leq V(u,w^{*})\quad\text{for all }w\in W,u\in U$$

Since this holds for all $w\in W$, it also holds for a maximizer, and therefore

$$\max_{w\in W}V(u^{*},w)\leq V(u,w^{*})\quad\text{for all }u\in U$$

The left-hand side will not be larger if instead of evaluating at $u=u^{*}\in U$, we minimize over all $u\in U$, giving

$$\min_{u\in U}\max_{w\in W}V(u,w)\leq V(u,w^{*})\quad\text{for all }u\in U$$

Now if this inequality holds for all $u\in U$, it also holds for the minimizer on the right-hand side so that

$$\min_{u\in U}\max_{w\in W}V(u,w)\leq\min_{u\in U}V(u,w^{*})$$

We can only increase the value of the right-hand side if instead of evaluating at $w=w^{*}\in W$, we maximize over all $w\in W$, giving

$$\min_{u\in U}\max_{w\in W}V(u,w)\leq\max_{w\in W}\min_{u\in U}V(u,w)$$

Note that this is the weak duality inequality Eq. 17 written in the reverse direction, so combining with weak duality, we have that

$$\min_{u\in U}\max_{w\in W}V(u,w)=\max_{w\in W}\min_{u\in U}V(u,w)$$

and strong duality is established.

We next show that $u^{*}$ solves the minmax problem. From the defined optimizations in Eq. 21 we have that

$$\min_{u\in U}\max_{w\in W}V(u,w) =\min_{u\in U}\overline{V}(u)$$ (18)

$$\max_{w\in W}\min_{u\in U}V(u,w) =\max_{w\in W}\underline{V}(w)$$ (19)

Next choose an arbitraru $u_{1}\in U$ and assume for contradiction that $\overline{V}(u_{1})<\overline{V}(u^{*})$. From the definition of $\overline{V}$ we then have have that

$$\max_{w\in W}V(u_{1},w)<\max_{w\in W}V(u^{*},w)$$

Therefore since $w^{*}\in W$

$$V(u_{1},w^{*})<\max_{w\in W}V(u^{*},w)$$

But from the saddle-point condition, Eq. 12, $\max_{w\in W}V(u^{*},w)\leq V(u,w^{*})$ for all $u\in U$, which contradicts the previous inequality since $u_{1}\in U$. Therefore $\overline{V}(u_{1})\geq\overline{V}(u^{*})$, and since $u_{1}$ is an arbitrary element of $U$, $u^{*}$ solves the minmax problem Eq. 18.

Similarly we can show that $w^{*}$ solves the maxmin problem Eq. 19 by exchanging the variables $w$ and $u$ and the operations $\max$ and $\min$. Therefore $(w^{*},u^{*})$ solves Eq. 14, and we have established that Eq. 12 implies Eq. 14. ∎

In the following development it is convenient to define the solutions to the inner minimization and maximization problems

$$\underline{u}^{0}(w):=\arg\min_{u\in U}V(u,w),\quad w\in W$$ (20)

$$\overline{w}^{0}(u):=\arg\max_{w\in W}V(u,w),\quad u\in U$$ (21)

Note that these inner solution sets are too “large” in the following sense. Even if we evaluate them at the optimizers of their respective outer problems, we know only that

$$u^{*}\subseteq\underline{u}^{0}(w^{*})\qquad w^{*}\subseteq\overline{w}^{0}(u^{*})$$

and these subsets may be strict. So we have to exercise some care when we exploit strong duality and want to extract the optimizer from a dual problem. We shall illustrate this issue in the upcoming results.

Quadratic functions.

In control problems, we min and max over possibly unbounded sets, so we need something other than compactness to guarantee existence of solutions. When we have linear dynamic models and quadratic stage cost (LQ), we can use the following results for quadratic functions.

Proposition 12 (Saddle-point theorem for quadratic functions).

Consider the quadratic function $V(\cdot):\mathbb{R}^{n+m}\rightarrow\mathbb{R}$

$$V(u,w)\coloneqq(1/2)\begin{bmatrix}u\\ w\end{bmatrix}^{\prime}\begin{bmatrix}M_{11}&M_{12}\\ M^{\prime}_{12}&M_{22}\end{bmatrix}\begin{bmatrix}u\\ w\end{bmatrix}+\begin{bmatrix}u\\ w\end{bmatrix}^{\prime}\begin{bmatrix}d_{1}\\ d_{2}\end{bmatrix}$$

with $M_{22}\in\mathbb{R}^{n\times n}\leq 0$, $M_{11}\in\mathbb{R}^{m\times m}\geq 0$, $M_{12}\in\mathbb{R}^{m\times n},d\in\mathbb{R}^{n+m}$.

1. A solution to $\min_{u}\max_{w}V$ exists if and only if $d\in R(M)$. Similarly, a solution to $\max_{w}\min_{u}V$ exists if and only if $d\in R(M)$.

2. For $d\in R(M)$, strong duality holds so that

   $$\min_{u}\max_{w}V(u,w)=\max_{w}\min_{u}V(u,w)=V(u^{*},w^{*})$$

   where $(u^{*},w^{*})$ are saddle points of the function $V$, satisfying

   $$\begin{bmatrix}u^{*}\\ w^{*}\end{bmatrix}\in-M^{+}d+N(M)\qquad V(u^{*},w^{*})=-(1/2)d^{\prime}M^{+}d$$ (22)

   and $dV(u,w)/d(u,w)=0$ at $(u^{*},w^{*})$.

3. For $d\in R(M)$, let $\underline{u}^{0}(w)\coloneqq\min_{u}V(u,w)$ and $\overline{w}^{0}(u)\coloneqq\max_{w}V(u,w)$. The solution sets and saddle points satisfy the following relationships

   $$u^{*} =\arg\min_{u}\max_{w}V(u,w), \quad u^{*} \subseteq\underline{u}^{0}(w^{*}),$$ (23)

   $$w^{*} =\arg\max_{w}\min_{u}V(u,w), \quad w^{*} \subseteq\overline{w}^{0}(u^{*}).$$ (24)

Proof.

First we establish that $(u^{*},w^{*})$ satisfy (22) by analyzing the $\min_{u}\max_{w}V$ problem. We assume $d\in R(M)$ and expand $V(\cdot)$ as

$$V(u,w)=(1/2)w^{\prime}M_{22}w+w^{\prime}(M_{12}^{\prime}u+d_{2})+(1/2)u^{\prime}M_{11}u+u^{\prime}d_{1}$$ (25)

From Proposition 5, $\max_{w}V$ exists if and only if $M_{12}^{\prime}u+d_{2}\in R(M_{22})$. This condition is satisfied for some nonempty set of $u$ by the bottom half of $d\in R(M)$. For such $u$ we have the necessary and sufficient condition for the optimum

$$M_{22}\overline{w}^{0}+M_{12}^{\prime}u+d_{2}=0$$ (26)

which defines an implicit function $\overline{w}^{0}(u)$, and optimal value given by (5)

$$\overline{w}^{0}(u) =-M^{+}_{22}(M_{12}^{\prime}u+d_{2})+N(M_{22})$$

$$V(u,\overline{w}^{0}(u)) =(1/2)u^{\prime}\tilde{M}_{22}u+u^{\prime}(d_{1}-M_{12}M_{22}^{+}d_{2})-(1/2)d_{2}M_{22}^{+}d_{2}$$

where $\tilde{M}_{22}$ is the Schur complement of $M_{22}$ defined in (8). Note that $\tilde{M}_{22}\geq 0$ since $M_{11}\geq 0$ and $M_{22}\leq 0$, which implies $M_{22}^{+}\leq 0$. However, we cannot simply set the derivative to zero because we require $M_{12}^{\prime}u+d_{2}\in R(M_{22})$ for the existence of $V(u,\overline{w}^{0}(u))=\max_{w}V(u,w)$. To handle this range constraint, we use a linear equality constraint $M_{12}^{\prime}u+d_{2}=M_{22}y$ where $y$ is a slack variable. Under the equality constraint, the problem $\min_{u}\max_{w}V$ is equivalent to the following constrained minimization:

$$\min_{u,y}V(u,\overline{w}^{0}(u))\qquad\textnormal{subject to}\qquad M_{12}^{\prime}u+d_{2}=M_{22}y.$$

Because $V(u,\overline{w}^{0}(u))$ is convex and differentiable in $(u,y)$, its minimum subject to the affine constraint $M_{12}^{\prime}u+d_{2}=M_{22}y$ is achieved by the stationary points of the Lagrangian (Boyd and Vandenberghe, 2004, pp. 141–142):

$$L(u,y,\lambda):=V(u,\overline{w}^{0}(u))+\lambda^{\prime}(M_{12}^{\prime}u+d_{2}-M_{22}y).$$

Taking derivatives, we have $(u^{*},y^{*},\lambda^{*})$ is a stationary point if and only if

$$\tilde{M}_{22}u^{*}+d_{1}-M_{12}M_{22}^{+}d_{2}+M_{12}\lambda^{*} =0$$ (27)

$$-M_{22}\lambda^{*} =0$$ (28)

$$M_{12}^{\prime}u^{*}+d_{2}-M_{22}y^{*} =0.$$ (29)

Substituting Eq. 29 into Eq. 27, we have

$$M_{11}u^{*}+M_{12}(\lambda^{*}-M_{22}^{+}M_{22}y^{*})+d_{1}=0.$$

Next, Eq. 28 implies $\lambda^{*}\in N(M_{22})$, so we can rewrite Eq. 29 as

$$M_{12}^{\prime}u^{*}+M_{22}(\lambda^{*}-M_{22}^{+}M_{22}y^{*})+d_{2}=0.$$

With $w^{*}:=\lambda^{*}-M_{22}^{+}M_{22}y^{*}$, we have the system Eqs. 29 and 27 as

$$\begin{bmatrix}M_{11}&M_{12}\\ M_{12}^{\prime}&M_{22}\end{bmatrix}\begin{bmatrix}u^{*}\\ w^{*}\end{bmatrix}+\begin{bmatrix}d_{1}\\ d_{2}\end{bmatrix}=0$$ (30)

which has solutions since $d\in R(M)$, and moreover, any such solution gives $y^{*}=-M_{22}^{+}M_{22}w^{*}$ and $\lambda^{*}=w^{*}+y^{*}$ satisfying Eqs. 27, 28 and 29. In fact, $w^{*}\subseteq\overline{w}^{0}(u^{*})$ is implied by Eqs. 28 and 29. Finally, solving Eq. 30 and substituting the solution into $V(u,w)$ gives Eq. 22.

To solve the $\max_{w}\min_{u}V$ problem, take the negative of the objective to obtain $\max_{w}\min_{u}V=-\min_{w}\max_{u}(-V)$. Therefore the exact same procedure can be used here, and it produces the same solutions and optimal values Eq. 22, along with $u^{*}\subseteq\underline{u}^{0}(w^{*})$.

Finally, note that if $d\notin R(M)$, we have no solution to $\max_{w}V(u,w)$ for any $u$, and therefore no solution to $\min_{u}\max_{w}V(u,w)$. Similarly we have no solution to $\min_{u}V(u,w)$ for any $w$, and therefore no solution to $\max_{w}\min_{u}V(u,w)$. We have thus established all the claims of the proposition. ∎

Applying Proposition 12 to the following example with $M_{11}=M_{22}=0$ and $M_{12}=1$

$$M=\begin{bmatrix}0&1\\ 1&0\end{bmatrix}\qquad V(u,w)=uw+\begin{bmatrix}u\\ w\end{bmatrix}^{\prime}d$$

gives $(u^{*},w^{*})=-(d_{2},d_{1})$, $V(u^{*},w^{*})=-d_{1}d_{2}$, $\overline{w}^{0}(u^{*})=\mathbb{R}$, $\underline{u}^{0}(w^{*})=\mathbb{R}$. Note that both functions $\overline{w}^{0}(\cdot)$ and $\underline{u}^{0}(\cdot)$ are defined at only a single point, $u^{*}$ and $w^{*}$, respectively. So in this degenerate case, these functions are not even differentiable.

Lagrangian functions.

The connections between constrained optimization problems via the use of Lagrange multipliers and game theory problems are useful (Rockafellar, 1993).

For optimization problems of convex type, Lagrange multipliers take on a game-theoretic role that could hardly even have been imagined before the creative insights of von Neumann [32], [33], in applying mathematics to models of social and economic conflict.

–T.A. Rockafellar

Next we are interested in the Lagrangian function $L(\cdot):\mathbb{R}^{n+m+1}\rightarrow\mathbb{R}$

$$L(u,w,\lambda) \coloneqq(1/2)\begin{bmatrix}u\\ w\end{bmatrix}^{\prime}\begin{bmatrix}M_{11}&M_{12}\\ M^{\prime}_{12}&M_{22}\end{bmatrix}\begin{bmatrix}u\\ w\end{bmatrix}-(1/2)\lambda(w^{\prime}w-1)$$

$$=(1/2)\begin{bmatrix}u\\ w\end{bmatrix}^{\prime}\begin{bmatrix}M_{11}&M_{12}\\ M^{\prime}_{12}&M_{22}-\lambda I\end{bmatrix}\begin{bmatrix}u\\ w\end{bmatrix}+\lambda/2$$

with $M\in\mathbb{R}^{(n+m)\times(n+m)}\geq 0$, and $M_{11}\in\mathbb{R}^{m\times m}$, $M_{12}\in\mathbb{R}^{m\times n}$, $M_{22}\in\mathbb{R}^{n\times n}$. Note that from Proposition 6, both $M_{11}\geq 0$ and $M_{22}\geq 0$ as well, so that $\max_{w}$ is not bounded unless $\lambda$ is large enough to make $M_{22}-\lambda I\leq 0$. The Schur complements of $M_{11}$ and $M_{22}-\lambda I$ are useful for expressing the solution.

$$\tilde{M}_{11}(\lambda) \coloneqq(M_{22}-\lambda I)-M_{12}^{\prime}M_{11}^{+}M_{12}$$

$$\tilde{M}_{22}(\lambda) \coloneqq M_{11}-M_{12}(M_{22}-\lambda I)^{+}M_{12}^{\prime}$$

Note that both Schur complements depend on the parameter $\lambda$.

Corollary 13 (Minmax and maxmin of a quadratic function with a parameter).

Consider the quadratic function $L(\cdot):\mathbb{R}^{n+m+1}\rightarrow\mathbb{R}$ expressed as

$$L(u,w,\lambda)\coloneqq(1/2)\begin{bmatrix}u\\ w\end{bmatrix}^{\prime}\begin{bmatrix}M_{11}&M_{12}\\ M^{\prime}_{12}&M_{22}-\lambda I\end{bmatrix}\begin{bmatrix}u\\ w\end{bmatrix}+\lambda/2$$ (31)

1. A solution to $\min_{u}\max_{w}L$ exists if and only if

   $$\lambda\geq\left|M_{22}\right|$$ (32)

   and the solution (set) and optimal value function are

   $$w^{0}(u) \in-(M_{22}-\lambda I)^{+}M_{12}^{\prime}\;u+N(M_{22}-\lambda I)$$

   $$u^{0} \in N(\tilde{M}_{22}(\lambda))$$

   $$L(u^{0},w^{0}(u^{0}),\lambda) =\begin{cases}\lambda/2,\quad&\lambda\geq\left|M_{22}\right|\\ +\infty,\quad&\lambda<\left|M_{22}\right|\end{cases}$$

2. A solution to $\max_{w}\min_{u}L$ exists if and only if

   $$\lambda\geq\left|M_{22}-M_{12}^{\prime}M_{11}^{+}M_{12}\right|$$ (33)

   and the solution (set) and optimal value function are

   $$u^{0}(w) \in-M_{11}^{+}M_{12}\;w+N(M_{11})$$

   $$w^{0} \in N(\tilde{M}_{11}(\lambda))$$

   $$L(u^{0}(w^{0}),w^{0},\lambda) =\begin{cases}\lambda/2,\quad&\lambda\geq\left|M_{22}-M_{12}^{\prime}M_{11}^{+}M_{12}\right|\\ +\infty,\quad&\lambda<\left|M_{22}-M_{12}^{\prime}M_{11}^{+}M_{12}\right|\end{cases}$$

3. Strong duality holds and the duality gap is zero for $\lambda\geq\left|M_{22}\right|$.

4. If $\left|M_{22}-M_{12}^{\prime}M_{11}^{+}M_{12}\right|<\left|M_{22}\right|$, then there is an unbounded duality gap for $\lambda$ in that interval

   $$\min_{u}\max_{w}L-\max_{w}\min_{u}L=+\infty,\quad\text{for }\left|M_{22}-M_{12}^{\prime}M_{11}^{+}M_{12}\right|\leq\lambda<\left|M_{22}\right|$$

Figure 1 illustrates a common outcome for Corollary 13. Note that the proof of Corollary 13 follows the proof of Proposition 14.

Figure 1: The optimal value function $L^{0}$ for $\min_{u}\max_{w}L$ and $\max_{w}\min_{u}L$ versus parameter $\lambda$. Strong duality holds only when $\lambda\geq\left|M_{22}\right|$. For $\lambda<\left|M_{22}\right|$, $\min_{u}\max_{w}L^{0}=+\infty$. For $\lambda<\left|M_{22}-M_{12}^{\prime}M_{11}^{+}M_{12}\right|$, $\max_{w}\min_{u}L^{0}=+\infty$.

Proposition 14 (Minmax and maxmin of a quadratic function with a parameter and a linear term).

Consider the quadratic function $L(\cdot):\mathbb{R}^{n+m+1}\rightarrow\mathbb{R}$ expressed as

$$L(u,w,\lambda) \coloneqq\frac{1}{2}\begin{bmatrix}u\\ w\end{bmatrix}^{\prime}\begin{bmatrix}M_{11}&M_{12}\\ M^{\prime}_{12}&M_{22}\end{bmatrix}\begin{bmatrix}u\\ w\end{bmatrix}+\begin{bmatrix}u\\ w\end{bmatrix}^{\prime}\begin{bmatrix}d_{1}\\ d_{2}\end{bmatrix}-\frac{\lambda}{2}(w^{\prime}w-1)$$

$$=\frac{1}{2}\begin{bmatrix}u\\ w\end{bmatrix}^{\prime}\underbrace{\begin{bmatrix}M_{11}&M_{12}\\ M^{\prime}_{12}&M_{22}-\lambda I\end{bmatrix}}_{M(\lambda)}\begin{bmatrix}u\\ w\end{bmatrix}+\begin{bmatrix}u\\ w\end{bmatrix}^{\prime}\begin{bmatrix}d_{1}\\ d_{2}\end{bmatrix}+\frac{\lambda}{2}$$

with $M(\lambda=0)\geq 0$.

1. A solution to $\min_{u}\max_{w}L$ exists if and only if

   $$\lambda\geq\left|M_{22}\right|$$ (34)

   and the solution (set) and optimal value function are

   $$w^{0}(u,\lambda) \in-(M_{22}-\lambda I)^{+}(M_{12}^{\prime}\;u+d_{2})+N(M_{22}-\lambda I)$$

   $$u^{0}(\lambda) \in-\tilde{M}^{+}_{22}(\lambda)(d_{1}-M_{12}(M_{22}-\lambda I)^{+}d_{2})+N(\tilde{M}_{22}(\lambda))$$

   $$L(u^{0},w^{0}(u^{0}),\lambda) =\begin{cases}\frac{\lambda}{2}-\frac{1}{2}d^{\prime}M^{+}(\lambda)d,\quad&\lambda\geq\left|M_{22}\right|\\ +\infty,\quad&\lambda<\left|M_{22}\right|\end{cases}$$

2. A solution to $\max_{w}\min_{u}L$ exists if and only if

   $$\lambda\geq\left|M_{22}-M_{12}^{\prime}M_{11}^{+}M_{12}\right|$$ (35)

   and the solution (set) and optimal value function are

   $$u^{0}(w,\lambda) \in-M_{11}^{+}(M_{12}\;w+d_{1})+N(M_{11})$$

   $$w^{0}(\lambda) \in-\tilde{M}^{+}_{11}(\lambda)(d_{2}-M^{\prime}_{12}M^{+}_{11}d_{1})+N(\tilde{M}_{11}(\lambda))$$

   $$L(u^{0}(w^{0}),w^{0},\lambda) =\begin{cases}\frac{\lambda}{2}-\frac{1}{2}d^{\prime}M^{+}(\lambda)d,\quad&\lambda\geq\left|M_{22}-M_{12}^{\prime}M_{11}^{+}M_{12}\right|\\ +\infty,\quad&\lambda<\left|M_{22}-M_{12}^{\prime}M_{11}^{+}M_{12}\right|\end{cases}$$

3. Strong duality holds and the duality gap is zero for $\lambda\geq\left|M_{22}\right|$.

4. If $\left|M_{22}-M_{12}^{\prime}M_{11}^{+}M_{12}\right|<\left|M_{22}\right|$, then there is an unbounded duality gap for $\lambda$ in that interval

   $$\min_{u}\max_{w}L-\max_{w}\min_{u}L=+\infty,$$

   $$\text{for }\left|M_{22}-M_{12}^{\prime}M_{11}^{+}M_{12}\right|\leq\lambda<\left|M_{22}\right|$$

Proof.

Expand $L$ as

$$L(u,w,\lambda)=\frac{1}{2}\big{(}u^{\prime}M_{11}u+2u^{\prime}M_{12}w+w^{\prime}(M_{22}-\lambda I)w+2u^{\prime}d_{1}+2w^{\prime}d_{2}+\lambda\big{)}$$

1. First note that $\max_{w}L$ exists if and only if $M_{22}-\lambda I\leq 0$. Otherwise $\max_{w}L(w,u,\lambda)=+\infty$. And $M_{22}-\lambda I\leq 0$ if and only if $\lambda\geq\left|M_{22}\right|$, which establishes (34). If this condition is satisfied, from Proposition 5 the solution is

   $$w^{0}(u) \in-(M_{22}-\lambda I)^{+}(M_{12}^{\prime}\;u+d_{2})+N(M_{22}-\lambda I)$$

   $$L(u,w^{0}(u),\lambda) =\frac{1}{2}\big{(}u^{\prime}\tilde{M}_{22}(\lambda)u+2u^{\prime}(d_{1}-M_{12}(M_{22}-\lambda I)^{+}d_{2})-d^{\prime}_{2}(M_{22}-\lambda I)^{+}d_{2}+\lambda\big{)}$$

   Since $M_{22}-\lambda I\leq 0$, we have that $(M_{22}-\lambda I)^{+}\leq 0$ as well and therefore $\tilde{M}_{22}(\lambda)\geq 0$. Therefore, $\min_{u}L(u,w^{0}(u))$ exists and the solution from Eq. 5 is

   $$u^{0}(\lambda)\in-\tilde{M}^{+}_{22}(\lambda)(d_{1}-M_{12}(M_{22}-\lambda I)^{+}d_{2})+N(\tilde{M}_{22}(\lambda))$$

   substituting $u^{0}$ and $w(u^{0})$ into $L$ gives

   $$L(u^{0},w^{0}(u^{0}),\lambda)=\begin{cases}\frac{\lambda}{2}-\frac{1}{2}d^{\prime}M^{+}(\lambda)d,\quad&\lambda\geq\left|M_{22}\right|\\ +\infty,\quad&\lambda<\left|M_{22}\right|\end{cases}$$

   and this part is established.

2. Since $M_{11}\geq 0$, $\min_{u}L$ exists from Proposition 5 and we have

   $$u^{0}(w) \in-M_{11}^{+}(M_{12}\;w+d_{1})+N(M_{11})$$

   $$L(u^{0}(w),w,\lambda) =\frac{1}{2}\big{(}w^{\prime}\tilde{M}_{11}(\lambda)w+2w^{\prime}(d_{2}-M^{\prime}_{12}M_{11}^{+}d_{1})-d^{\prime}_{1}M^{+}_{11}d_{1}+\lambda\big{)}$$

   Next note that $\max_{w}L(u^{0}(w),w,\lambda)$ exists if and only if $\tilde{M}_{11}(\lambda)\leq 0$, or

   $$0 \geq(M_{22}-\lambda I)-M_{12}^{\prime}M_{11}^{+}M_{12}$$

   $$\lambda I \geq M_{22}-M_{12}^{\prime}M_{11}^{+}M_{12}$$

   and the last inequality is satisfied if and only if $\lambda\geq\left|M_{22}-M_{12}^{\prime}M_{11}^{+}M_{12}\right|$. If that does not hold $\max_{w}L(u^{0}(w),w,\lambda)=+\infty$, which establishes (34). When this condition is satisfied

   $$w^{0}(\lambda)\in-\tilde{M}^{+}_{11}(\lambda)(d_{2}-M^{\prime}_{12}M^{+}_{11}d_{1})+N(\tilde{M}_{11}(\lambda))$$

   Substituting these values into $L$ gives

   $$L(u^{0}(w^{0}),w^{0},\lambda)=\begin{cases}\frac{\lambda}{2}-\frac{1}{2}d^{\prime}M^{+}(\lambda)d,\quad&\lambda\geq\left|M_{22}-M_{12}^{\prime}M_{11}^{+}M_{12}\right|\\ +\infty,\quad&\lambda<\left|M_{22}-M_{12}^{\prime}M_{11}^{+}M_{12}\right|\end{cases}$$

   and this part is established.

3. Recall from Proposition 6 that $M\geq 0$ implies $M_{11}\geq 0$, $M_{22}\geq 0$, and $M_{22}-M_{12}^{\prime}M_{11}^{+}M_{12}\geq 0$. Since $M_{11}\geq 0$, $M_{11}^{+}\geq 0$ as well and therefore $M_{12}^{\prime}M_{11}^{+}M_{12}\geq 0$. Therefore $0\leq M_{22}-M_{12}^{\prime}M_{11}^{+}M_{12}\leq M_{22}$, which implies $\left|M_{22}-M_{12}^{\prime}M_{11}^{+}M_{12}\right|\leq\left|M_{22}\right|$. So for $\lambda>\left|M_{22}\right|$, both $\min_{u}\max_{w}L$ and $\max_{w}\min_{u}L$ have value $\frac{\lambda}{2}-\frac{1}{2}d^{\prime}M^{+}(\lambda)d$, and strong duality holds.

4. If $M$ is such that $\left|M_{22}-M_{12}^{\prime}M_{11}^{+}M_{12}\right|<\left|M_{22}\right|$, then for $\lambda$ satisfying $\left|M_{22}-M_{12}^{\prime}M_{11}^{+}M_{12}\right|\leq\lambda<\left|M_{22}\right|$, we have $\min_{u}\max_{w}L=+\infty$ and $\max_{w}\min_{u}L=\frac{\lambda}{2}-\frac{1}{2}d^{\prime}M^{+}(\lambda)d$, so the duality gap is infinite, which establishes this part. ∎

Note that setting $d=0$ in the proof of Proposition 14 establishes Corollary 13.

For strong duality to hold for all $\lambda$ such that either problem has a bounded solution requires that $\left|M_{22}\right|=\left|M_{22}-M_{12}^{\prime}M_{11}^{+}M_{12}\right|$. The following example shows that it is not necessary for $M_{12}^{\prime}M_{11}^{+}M_{12}=0$ for this condition to hold.

$$M_{22}=M_{12}=\begin{bmatrix}1&0\\ 0&1\end{bmatrix}\qquad M_{11}=\begin{bmatrix}1&0\\ 0&0\end{bmatrix}=M_{11}^{+}$$

$$M_{22}-M_{12}^{\prime}M_{11}^{+}M_{12}=\begin{bmatrix}0&0\\ 0&1\end{bmatrix}$$

We have that $\left|M_{22}\right|=1$ and $\left|M_{22}-M_{12}^{\prime}M_{11}^{+}M_{12}\right|=1$, so the norms are equal but $M_{12}^{\prime}M_{11}^{+}M_{12}=M_{11}^{+}\neq 0$.

Constrained quadratic optimization

A mysterious piece of information has been uncovered. In our innocence we thought we were engaged straightforwardly in solving a single problem (P). But we find we’ve assumed the role of Player 1 in a certain game in which we have an adversary, Player 2, whose interests are diametrically opposed to ours!

–T.A. Rockafellar

We next consider maximization of a convex function so that a constraint is required for even existence of a solution. We establish the following result.

Proposition 15 (Constrained quadratic optimization).

Define the convex quadratic function, $V(\cdot):\mathbb{R}^{n}\rightarrow\mathbb{R}$ and compact constraint set $W$

$$V(w)\coloneqq(1/2)w^{\prime}Dw+w^{\prime}d\qquad W\coloneqq\{w\mid w^{\prime}w=1\}$$

with $D\in\mathbb{R}^{n\times n}\geq 0$. Consider the constrained maximization problem

$$\max_{w\in W}V(w)$$ (36)

Define the Lagrangian function

$$L(w,\lambda)=V(w)-(1/2)\lambda(w^{\prime}w-1)$$

and the (unconstrained) Lagrangian problem

$$\max_{w}\min_{\lambda}L(w,\lambda)$$ (37)

and the (unconstrained) dual Lagrangian problem

$$\min_{\lambda}\max_{w}L(w,\lambda)$$ (38)

1. Solutions to all three problems (36), (37), and (38) exist for all $D\geq 0$ and $d\in\mathbb{R}^{n}$ with optimal value

   $$V^{0}=L^{0}=-(1/2)d^{\prime}(D-\lambda_{P}I)^{+}d+\lambda_{P}/2$$

   where

   $$\lambda_{P}:=\;\text{the largest real eigenvalue of $P$}\qquad P\coloneqq\begin{bmatrix}D&I\\ dd^{\prime}&D\end{bmatrix}$$ (39)

2. Problems (37) and (38) satisfy strong duality, and the function $L(w,\lambda)$ has saddle points (sets) $(w^{*},\lambda^{*})$ given by

   $$w^{*} =\begin{cases}\bigg{(}-(D-\lambda_{P}I)^{+}d+N(D-\lambda_{P}I)\bigg{)}\cap W,\quad&\lambda_{P}=\left|D\right|\\ -(D-\lambda_{P}I)^{-1}d,\qquad&\lambda_{P}>\left|D\right|\end{cases}$$

   $$\lambda^{*} =\lambda_{P}$$

3. The optimizer of (36) is given by $w^{0}=w^{*}$.

4. The optimizer of (37) is given by

   $$w^{0}=w^{*}\qquad\underline{\lambda}^{0}(w^{0})=\mathbb{R}$$

5. The optimizer of (38) is given by

   $$\overline{w}^{0}(\lambda^{0}) =\begin{cases}-(D-\lambda_{P}I)^{+}d+N(D-\lambda_{P}I),\quad&\lambda_{P}=\left|D\right|\\ -(D-\lambda_{P}I)^{-1}d,\qquad&\lambda_{P}>\left|D\right|\end{cases}$$

   $$\lambda^{0} =\lambda_{P}$$

6. Additionally $\lambda_{P}=\left|D\right|$ if and only if (i) $d\in R(D-\left|D\right|I)$ and (ii) $\left|(D-\left|D\right|I)^{+}d\right|\leq 1$. If (i) or (ii) do not hold, then $\lambda_{P}>\left|D\right|$ and $\left|(D-\lambda_{P}I)^{-1}d\right|=1$.

Figure 2 shows the possible behaviors. The green lines show the case $d\in R(D-\left|D\right|I)$, for different $\left|d\right|$. For $d=0$ (bottom green line), $\lambda_{P}=\left|D\right|$ and the optimum is on the boundary. Increasing $\left|d\right|$ eventually produces a zero derivative at $\lambda=\left|D\right|$ (third green line from bottom). Further increasing $\left|d\right|$ makes the derivative at $\lambda=\left|D\right|$ negative (top two green lines), and $\lambda_{P}>\left|D\right|$ (red dots), and the optimum moves to the interior. The blue line shows the case $d\notin R(D-\left|D\right|I)$. $L$ is unbounded at $\lambda=\left|D\right|$, $\lambda_{P}>\left|D\right|$ (blue dot) and the optimum is again in the interior.

Figure 2: $L(w^{0}(\lambda),\lambda)$ versus $\lambda$ for the same $D$ but different $d$. Green lines: for $d\in R(D-\left|D\right|I)$, $L$ is bounded for all $\lambda\geq\left|D\right|$. Green dots: for $\left|(D-\left|D\right|I)^{+}d\right|\leq 1$, the optimum is on the boundary and $\lambda_{P}=\left|D\right|$. Red dots: for $\left|(D-\left|D\right|I)^{+}d\right|>1$, the optimum is in the interior and $\lambda_{P}>\left|D\right|$. Blue line and dot: for $d\notin R(D-\left|D\right|I)$, $L$ is unbounded at $\lambda=\left|D\right|$, and the optimum is in the interior, and $\lambda_{P}>\left|D\right|$.

To organize the proof of this proposition, we treat the Lagrangian, dual Lagrangian, and saddle-point problems in separate lemmas, and then combine them. We start with the dual Lagrangian minmax problem. We shall find that all of the information about $\lambda_{P}$ emerges from this problem.

Lemma 16 (Dual Lagrangian of constrained quadratic optimization).

Consider the dual Lagrangian problem

$$\min_{\lambda}\max_{w}L(w,\lambda)\qquad L(w,\lambda)\coloneqq(1/2)w^{\prime}Dw+w^{\prime}d-(1/2)\lambda(w^{\prime}w-1)$$ (40)

with $D\geq 0$. We have the following results.

1. This problem is equivalent to

   $$\min_{\lambda\geq\left|D\right|}\max_{w}L(w,\lambda)$$

2. The solution exists for all $D$ and $d$ and has optimal value

   $$L^{0}=-(1/2)d^{\prime}(D-\lambda_{P}I)^{+}d+\lambda_{P}/2$$ (41)

   where $\lambda_{P}$ and matrix $P\in\mathbb{R}^{2n\times 2n}$ are defined as

   $$\lambda_{P}\coloneqq\;\text{the largest real eigenvalue of $P$}\qquad P\coloneqq\begin{bmatrix}D&I\\ dd^{\prime}&D\end{bmatrix}$$ (42)

3. The optimal $\lambda$ and $w^{0}(\lambda)$ are given by

   $$\lambda^{0} =\lambda_{P}\in[\left|D\right|,\infty)$$

   $$w^{0}(\lambda^{0}) =\begin{cases}-(D-\left|D\right|I)^{+}d+N(D-\left|D\right|I),\quad&\lambda_{P}=\left|D\right|\\ -(D-\lambda_{P}I)^{-1}d,\quad&\lambda_{P}\in(\left|D\right|,\infty)\end{cases}$$

4. We have that $\lambda_{P}=\left|D\right|$ if and only if (i) $d\in R(D-\left|D\right|I)$, and (ii) $\left|(D-\left|D\right|I)^{+}d\right|\leq 1$. Otherwise $\lambda_{P}>\left|D\right|$. If (i) is violated, $L(w^{0}(\lambda),\lambda)=+\infty$ at $\lambda=\left|D\right|$. If (i) holds but (ii) is violated, then $L(w^{0}(\lambda,\lambda)$ is finite at $\lambda=\left|D\right|$, but $(d/d\lambda)L(w^{0}(\lambda),\lambda)<0$ at $\lambda=\left|D\right|$.

Proof.

To establish statement 1 in the lemma, note that if $\lambda<\left|D\right|$, then $D-\lambda I>0$ and $\max_{w}L(w,\lambda)=+\infty$. So adding the constraint $\lambda\geq\left|D\right|$ to the outer minimization does not alter the solution.

To establish statements 2–4 in the lemma, we make use of the SVD of matrix $D=UMU^{\prime}$, which we partition as

$$D=\begin{bmatrix}U_{1}&U_{2}\end{bmatrix}\begin{bmatrix}\left|D\right|I_{p}&\\ &M_{2}\end{bmatrix}\begin{bmatrix}U_{1}^{\prime}\\ U_{2}^{\prime}\end{bmatrix}$$

where $p$ is the multiplicity of the largest eigenvalue of $D$, $1\leq p\leq n$. Also denote $y=U^{\prime}d,y_{1}=U_{1}^{\prime}d,y_{2}=U_{2}^{\prime}d$.

We break the problem into two cases.

1. Case $\lambda_{P}\in(\left|D\right|,\infty)$.

   For $\lambda\in(\left|D\right|,\infty)$, we have from Proposition 5 that $w^{0}(\lambda)=-(D-\lambda I)^{-1}d$ and $L(w^{0}(\lambda),\lambda)=-(1/2)d^{\prime}(D-\lambda I)^{-1}d+\lambda/2$ . $L(w^{0}(\lambda),\lambda)$ is differentiable, and taking two derivatives gives

   $$\frac{dL}{d\lambda} =(1/2)(1-d^{\prime}(D-\lambda I)^{-2}d)$$

   $$\frac{d^{2}L}{d\lambda^{2}} =-d^{\prime}(D-\lambda I)^{-3}d$$

   Setting the first derivative to zero yields

   $$0 =1-d^{\prime}(D-\lambda I)^{-2}d$$ (43)

   $$=\det(1-d^{\prime}(D-\lambda I)^{-2}d)$$

   $$=\det(I-dd^{\prime}(D-\lambda I)^{-2})$$

   $$=\det(D-\lambda I)-dd^{\prime}(D-\lambda I)^{-1})\det(D-\lambda I)^{-1}$$

   where we have used the fact that $\det(I+AB)=\det(I+BA)$. Since $\det(D-\lambda I)\neq 0$, we can multiply both sides of the last equality by $\det(D-\lambda I)^{2}$ to obtain

   $$0 =\det(D-\lambda I)-dd^{\prime}(D-\lambda I)^{-1})\det(D-\lambda I)$$

   $$=\det\left(\begin{bmatrix}D-\lambda I&I\\ dd^{\prime}&D-\lambda I\end{bmatrix}\right)=\det(P-\lambda I)$$

   where we have used the partitioned determinant formula, which is valid since $D-\lambda I$ is nonsingular for $\lambda>\left|D\right|$. Therefore the first derivative of $L$ vanishes in the interval $(\left|D\right|,\infty)$ if and only if there exists a real-valued eigenvalue of $P$ in this interval. Also, we have from Eq. 43 that

   $$1=d^{\prime}(D-\lambda I)^{-2}d=d^{\prime}U(M-\lambda I)^{-2}U^{\prime}d=y^{\prime}(M-\lambda I)^{-2}y$$

   with $y\coloneqq U^{\prime}d$. So we conclude that $y\neq 0$ for this case. Examining the second derivative, we have

   $$\frac{d^{2}L}{d\lambda^{2}}=d^{\prime}(\lambda I-D)^{-3}d=y^{\prime}(\lambda I-M)^{-3}y$$

   Note that since $\lambda>\left|D\right|$, $(\lambda I-M)^{-3}>0$, and since $y\neq 0$, we have that $d^{2}L/d\lambda^{2}>0$ on $(\left|D\right|,\infty)$ and therefore $L(w^{0}(\lambda),\lambda)$ is strictly convex on this interval. Therefore the minimizer of $L$ is unique and the first derivative is zero at the solution. We also know that there is only one real eigenvalue of $P$ in this interval due to the uniqueness of the optimal solution. Therefore we have established that $\lambda^{0}=\lambda_{P}\in(\left|D\right|,\infty)$ is the optimal solution. Substituting this solution into $L$ gives

   $$L^{0}=L(w^{0}(\lambda^{0}),\lambda^{0})=-(1/2)d^{\prime}(D-\lambda_{P}I)^{-1}d+\lambda_{P}/2$$

   verifying that (41) holds for the first case.

2. Case $\lambda_{P}\notin(\left|D\right|,\infty)$. In this case, we first show that the $\lambda^{0}=\left|D\right|$. Using the SVD, we have for $\lambda\in(\left|D\right|,\infty)$

   $$L(w^{0}(\lambda),\lambda) =-(1/2)d^{\prime}(D-\lambda I)^{-1}d+\lambda/2$$

   $$=-(1/2)\begin{bmatrix}y_{1}^{\prime}&y_{2}^{\prime}\end{bmatrix}\begin{bmatrix}\frac{1}{\left|D\right|-\lambda}I_{p}&\\ &(M_{2}-\lambda I)^{-1}\end{bmatrix}\begin{bmatrix}y_{1}\\ y_{2}\end{bmatrix}+\lambda/2$$

   From this expression for $L$, note that $y_{1}=U_{1}^{\prime}d$ must be zero for this case, or $\lim_{\lambda\rightarrow\left|D\right|^{+}}L(w^{0}(\lambda),\lambda)=+\infty$, which is a contradiction since $\lim_{\lambda\rightarrow+\infty}L(w^{0}(\lambda),\lambda)=+\infty$ as well, and $L$ is a smooth function on the interval $(\left|D\right|,\infty)$, so it must have a minimum on that interval (zero derivative), but by assumption it does not have a zero derivative on that interval. Note that $y_{1}=U_{1}^{\prime}d=0$ is equivalent to $d\in R(D-\left|D\right|I)$, which can be seen from the SVD of $D-\left|D\right|I$

   $$D-\left|D\right|I=\begin{bmatrix}U_{1}&U_{2}\end{bmatrix}\begin{bmatrix}0&\\ &M_{2}-\left|D\right|I\end{bmatrix}\begin{bmatrix}U_{1}^{\prime}\\ U_{2}^{\prime}\end{bmatrix}$$

   so the columns of $U_{1}$ are a basis for $N(D-\left|D\right|I)$ and $d$ is orthogonal to the columns of $U_{1}$ so $d\in R(D-\left|D\right|I)$. Substituting $y_{1}=0$, into the expression for $L(w^{0}(\lambda),\lambda)$ gives

   $$L(w^{0}(\lambda),\lambda)=-(1/2)d^{\prime}(D-\lambda I)^{+}d+\lambda/2,\qquad\lambda\geq\left|D\right|,\;d\in R(D-\left|D\right|I)$$ (44)

   and $L(w^{0}(\lambda),\lambda)$ is smooth on the interval including the left boundary, $[\left|D\right|,\infty)$, and the optimizer must be on the boundary, $\lambda^{0}=\left|D\right|$. For this value of $\lambda$, the inner maximization over $w$ gives from Proposition 5

   $$w^{0}(\lambda^{0})=-(1/2)(D-\left|D\right|I)^{+}d+N(D-\left|D\right|I)$$

   and evaluating $L^{0}$ gives

   $$L(w^{0}(\lambda^{0}),\lambda^{0}) =-(1/2)y_{2}^{\prime}(M_{2}-\left|D\right|I)^{-1}y_{2}+\left|D\right|/2$$

   $$=-(1/2)d^{\prime}(D-\left|D\right|I)^{+}d+\left|D\right|/2\qquad$$ (45)

   verifying Eq. 41 for this case.

   Taking the derivative of Eq. 44 and evaluating at $\lambda=\left|D\right|$ gives

   $$(d/d\lambda)L(w^{0}(\lambda),\lambda)=(1/2)(1-d^{\prime}((D-\left|D\right|I)^{+})^{2}d)=(1/2)(1-\left|(D-\left|D\right|I)^{+}d\right|^{2})$$

   which is non-negative if and only if $\left|(D-\left|D\right|I)^{+}d\right|\leq 1$. Otherwise the derivative at the boundary is negative and the optimal $\lambda$ is in the interval $(\left|D\right|,\infty)$, which is the previous case. Therefore $\lambda^{0}=\left|D\right|$ if and only if

   $$d\in R(D-\left|D\right|I),\quad\left|(D-\left|D\right|I)^{+}d\right|\leq 1$$

   Next we show that $\left|D\right|$ is an eigenvalue of $P$ in this case. Factoring $P-\lambda I$ gives

   $$P-\lambda I =\begin{bmatrix}U&\\ &U\end{bmatrix}\begin{bmatrix}U^{\prime}DU-\lambda I&I\\ U^{\prime}dd^{\prime}U&U^{\prime}DU-\lambda I\end{bmatrix}\begin{bmatrix}U^{\prime}&\\ &U^{\prime}\end{bmatrix}$$

   $$=\begin{bmatrix}U&\\ &U\end{bmatrix}\begin{bmatrix}(\left|D\right|-\lambda)I_{p}&&I&\\ &M_{2}-\lambda I&&I\\ y_{1}y_{1}^{\prime}&y_{1}y_{2}^{\prime}&(\left|D\right|-\lambda)I_{p}&\\ y_{2}y_{1}^{\prime}&y_{2}y_{2}^{\prime}&&M_{2}-\lambda I\end{bmatrix}\begin{bmatrix}U^{\prime}&\\ &U^{\prime}\end{bmatrix}$$

   Since the leading and trailing matrices are inverses of each other, we have a similarity transformation, and the eigenvalues of the inner matrix are the eigenvalues of $P$. Setting $y_{1}=0$ in the inner matrix and setting $\lambda=\left|D\right|$ gives a zero third block row of the inner matrix, and it is singular. Therefore $\lambda=\left|D\right|$ is an eigenvalue of $P$. Since there are no real eigenvalues of $P$ in $(\left|D\right|,\infty)$, we have that $\left|D\right|$ is the largest real eigenvalue of $P$ for this case, and we have established that $\lambda^{0}=\lambda_{P}$ also for this case.

Summarizing, we have broken the problem into two cases. In the first case we have shown that $\lambda^{0}=\lambda_{P}>\left|D\right|$, and $(d/d\lambda)L(w^{0}(\lambda),\lambda)$ is zero at $\lambda=\lambda_{P}$. In this case there is only one real eigenvalue of $P$ in $(\left|D\right|,\infty)$.

In the second case, we have that $\lambda^{0}=\lambda_{P}=\left|D\right|$, the boundary of the feasible set. We have also shown that $d\in R(D-\left|D\right|I)$, and $\left|(D-\left|D\right|I)^{+}d\right|\leq 1$ for this case. If $d\notin R(D-\left|D\right|I)$, then $L(w^{0}(\lambda),\lambda)$ is $+\infty$ at $\lambda=\left|D\right|$, which is in the first case. If $d\in R(D-\left|D\right|I)$, but $\left|(D-\left|D\right|I)^{+}d\right|>1$, then $L(w^{0}(\lambda),\lambda)$ is finite at $\lambda=\left|D\right|$, but the derivative is negative, which is again in the first case. Thus we have established statements 2–4 in the lemma and the proof is complete. ∎

Next we turn to the saddle points.

Lemma 17 (Saddle points of the Lagrangian of constrained quadratic optimization).

The following $(w^{*},\lambda^{*})$ are saddle points of $L(w,\lambda)\coloneqq(1/2)w^{\prime}Dw+w^{\prime}d-(1/2)\lambda(w^{\prime}w-1)$.

$$w^{*} =\begin{cases}\bigg{(}(D-\left|D\right|I)^{+}d+N(D-\left|D\right|I)\bigg{)}\cap W\quad&\lambda_{P}=\left|D\right|\\ (D-\lambda_{P}I)^{-1}d,\quad&\lambda_{P}>\left|D\right|\end{cases}$$

$$\lambda^{*} =\lambda_{P}$$

Proof.

From the definition of a saddle point we need to establish the inequalities

$$L(w,\lambda^{*})\leq L(w^{*},\lambda^{*})\leq L(w^{*},\lambda)$$

hold for all $w\in\mathbb{R}^{n}$ and $\lambda\in\mathbb{R}$.

Taking the second inequality first, we have that $L(w^{*},\lambda)=(1/2)(w^{*})^{\prime}Dw^{*}+(w^{*})^{\prime}d$ for all $\lambda$ since $(w^{*})^{\prime}w^{*}=1$. Therefore $L(w^{*},\lambda)=L(w^{*},\lambda^{*})$ for all $\lambda$ and the second inequality is established with equality.

Turning to the first inequality, we consider the two cases; (i) $\lambda^{*}=\lambda_{P}>\left|D\right|$, and (ii) $\lambda^{*}=\lambda_{P}=\left|D\right|$ and $d\in R(D-\left|D\right|I)$. For the first case we know that

$$\max_{w}L(w,\lambda_{P})=-(1/2)d^{\prime}(D-\lambda_{P}I)^{-1}d+\lambda_{P}/2=L(w^{*},\lambda_{P})=L(w^{*},\lambda^{*})$$

where the maximization over $w$ is unconstrained, and the first equality follows from Proposition 5. Since this equality holds for the maximizer, we have that $L(w,\lambda^{*})=L(w,\lambda_{P})\leq L(w^{*},\lambda^{*})$ for all $w\in\mathbb{R}^{n}$, where the first equality comes from the definition of $\lambda^{*}$. Thus the first inequality holds for the first case.

Turning to the second case, we have similarly from Proposition 5

$$\max_{w}L(w,\left|D\right|)=-(1/2)d^{\prime}(D-\left|D\right|I)^{+}d+\left|D\right|/2=L(w^{*},\left|D\right|)=L(w^{*},\lambda^{*})$$

where again the maximization over $w$ is unconstrained, and we have $L(w,\lambda^{*})=L(w,\left|D\right|)\leq L(w^{*},\lambda^{*})$ for all $w\in\mathbb{R}^{n}$. Thus both cases satisfy the first inequality, both inequalities have been established, and the result is proven. ∎

Finally, we address the original constrained optimization of the concave quadratic function and its Lagrangian

Lemma 18 (Constrained quadratic optimization and its Lagrangian).

We are given the following: (i) a convex quadratic function and compact constraint set $W$ defined in Proposition 15

$$V(w)\coloneqq(1/2)w^{\prime}Dw+w^{\prime}d\qquad W\coloneqq\{w\mid w^{\prime}w=1\}$$

with $D\in\mathbb{R}^{n\times n}\geq 0$, (ii) the constrained maximization problem Eq. 36

$$\max_{w\in W}V(w)$$

with Lagrangian function

$$L(w,\lambda)=V(w)-(1/2)\lambda(w^{\prime}w-1)$$

and the (unconstrained) Lagrangian problem Eq. 37

$$\max_{w}\min_{\lambda}L(w,\lambda)$$

1. Solutions to (36) and (37) exist for all $D\geq 0$ and $d\in\mathbb{R}^{n}$ and achieve the same optimal value $V^{0}=L^{0}=-(1/2)d^{\prime}(D-\lambda_{P}I)^{+}d+\lambda_{P}/2$.

2. The optimizer of Eq. 36, denoted $w^{0}$, is given by $w^{0}=w^{*}$ where $w^{*}$ the saddle-point solution set from Lemma 17.

3. The optimizer of Eq. 37, denoted $(w_{L}^{0},\underline{\lambda}(w_{L}^{0}))$ is given by $w_{L}^{0}=w^{*}$ and $\underline{\lambda}(w_{L}^{0})=\mathbb{R}$.

Proof.

The solution to (36) exists since $V(\cdot)$ is continuous and $W$ is compact. The solution to Eq. 37 exists and satisfies strong duality with (38) due to the saddle-point theorem (Proposition 12) and Lemma 17, so we have that

$$L^{0}=\max_{w}\min_{\lambda}L=\min_{\lambda}\max_{w}L=-(1/2)d^{\prime}(D-\lambda_{P}I)^{+}d+\lambda_{P}/2$$

where the last equality follows by (41). From the saddle-point theorem, we also have that $w_{L}^{0}=w^{*}$ for the optimizer of the Lagrangian. Since $w_{L}^{0}$ satisfies $(w_{L}^{0})^{\prime}w_{L}^{0}=1$, it follows that $\underline{\lambda}^{0}(w_{L}^{0})=\mathbb{R}$. Finally, we have that value $V^{0}=L^{0}$ and set $w^{0}=w_{L}^{0}$ by Proposition 7, and the proof is complete. ∎

The proofs of Lemma 16, Lemma 17, and Lemma 18 have proven Proposition 15.

Discussion of Proposition 15.

The basic problem of constrained, nonconvex quadratic optimization has appeared in several fields. In the optimization literature it is known as the “trust-region” problem. Nocedal and Wright discuss the numerical solution of the trust-region problem in the context of nonlinear programming (Nocedal and Wright, 2006, p.69). Boyd and Vandenberghe establish strong dualilty of the Lagrangian and dual Langrangian formulations of the problem (Boyd and Vandenberghe, 2004, Appendix B). The complete solution provided in Proposition 15 appears to be new to this work. The authors would also like to acknowledge Robin Strässer for his work on earlier versions of Proposition 15 (Mannini et al., 2024).

Constrained minmax and maxmin.

To compactly state the results in this section it is convenient to define two functions

$$M(\lambda)\coloneqq\begin{bmatrix}M_{11}&M_{12}\\ M^{\prime}_{12}&M_{22}-\lambda I\end{bmatrix}\qquad L(\lambda)\coloneqq-(1/2)d^{\prime}M^{+}(\lambda)d+\lambda/2$$

and for convenience, we repeat the definition of the Schur complements

$$\tilde{M}_{11}(\lambda)\coloneqq(M_{22}-\lambda I)-M_{12}^{\prime}M_{11}^{+}M_{12}\qquad\tilde{M}_{22}(\lambda)\coloneqq M_{11}-M_{12}(M_{22}-\lambda I)^{+}M_{12}^{\prime}$$

Corollary 19 (Minmax and maxmin of constrained quadratic functions).

Consider quadratic function $V(\cdot):\mathbb{R}^{n+m}\rightarrow\mathbb{R}$ and compact constraint set $W$

$$V(u,w)\coloneqq\frac{1}{2}\begin{bmatrix}u\\ w\end{bmatrix}^{\prime}\begin{bmatrix}M_{11}&M_{12}\\ M^{\prime}_{12}&M_{22}\end{bmatrix}\begin{bmatrix}u\\ w\end{bmatrix}\qquad W\coloneqq\{w\mid w^{\prime}w=1\}$$

with $M\in\mathbb{R}^{(n+m)\times(n+m)}\geq 0$, $M_{22}\in\mathbb{R}^{n\times n}$, $M_{11}\in\mathbb{R}^{m\times m}$, $M_{12}\in\mathbb{R}^{m\times n}$, and the two constrained optimization problems.

$$\min_{u} \max_{w\in W} V(u,w)$$ (46)

$$\max_{w\in W} \min_{u} V(u,w)$$ (47)

1. The solution to (46) is

   $$V(u^{0},w^{0}(u^{0})) =\frac{\lambda^{0}}{2}$$

   $$u^{0} \in N(\tilde{M}_{22}(\lambda^{0}))$$

   $$w^{0}(u^{0}) \in\bigg{(}-(M_{22}-\lambda^{0}I)^{+}M_{12}^{\prime}\;u^{0}+N(M_{22}-\lambda^{0}I)\bigg{)}\cap W$$

   with $\lambda^{0}=\left|M_{22}\right|$.

2. The solution to (47) is

   $$V(u^{0}(w^{0}),w^{0}) =\frac{\lambda^{0}}{2}$$

   $$w^{0} \in\big{(}N(\tilde{M}_{11}(\lambda^{0}))\big{)}\cap W$$

   $$u^{0}(w^{0}) \in-M_{11}^{+}M_{12}\;w^{0}+N(M_{11})$$

   with $\lambda^{0}=\left|M_{22}-M_{12}^{\prime}M_{11}^{+}M_{12}\right|$.

The proof of Corollary 19 is given at the end of the proof of Proposition 20.

Next we add the linear term to $V(u,w)$, which may seem harmless but actually precludes a closed-form solution as in Corollary 19. Here a nonlinear optimization over scalar $\lambda$ remains.

Proposition 20 (Minmax and maxmin of constrained quadratic functions with linear term).

Consider quadratic function $V(\cdot):\mathbb{R}^{n+m}\rightarrow\mathbb{R}$ and compact constraint set $W$

$$V(u,w)\coloneqq\frac{1}{2}\begin{bmatrix}u\\ w\end{bmatrix}^{\prime}\begin{bmatrix}M_{11}&M_{12}\\ M^{\prime}_{12}&M_{22}\end{bmatrix}\begin{bmatrix}u\\ w\end{bmatrix}+\begin{bmatrix}u\\ w\end{bmatrix}^{\prime}\begin{bmatrix}d_{1}\\ d_{2}\end{bmatrix}\qquad W\coloneqq\{w\mid w^{\prime}w=1\}$$

with $M\in\mathbb{R}^{(n+m)\times(n+m)}\geq 0$, and the two constrained optimization problems.

$$\min_{u} \max_{w\in W} V(u,w)$$ (48)

$$\max_{w\in W} \min_{u} V(u,w)$$ (49)

1. The solution to (48) is

   $$V(u^{0},w^{0}(u^{0})) =-(1/2)d^{\prime}M^{+}(\lambda^{0})d+\lambda^{0}/2$$

   $$u^{0} \in-\tilde{M}^{+}_{22}(\lambda^{0})(d_{1}-M_{12}(M_{22}-\lambda^{0}I)^{+}d_{2})+N(\tilde{M}_{22}(\lambda^{0}))$$

   $$w^{0}(u^{0}) \in\bigg{(}-(M_{22}-\lambda^{0}I)^{+}(M_{12}^{\prime}\;u^{0}+d_{2})+-N(M_{22}-\lambda^{0}I)\bigg{)}\cap W$$

   where $\lambda^{0}$ must be computed from the following nonlinear optimization problem

   $$\lambda^{0}=\arg\min_{\lambda\geq\left|M_{22}\right|}L(\lambda)$$

2. The solution to (49) is

   $$V(u^{0}(w^{0}),w^{0}) =-(1/2)d^{\prime}M^{+}(\lambda^{0})d+\lambda^{0}/2$$

   $$w^{0} \in\bigg{(}-\tilde{M}^{+}_{11}(\lambda^{0})(d_{2}-M^{\prime}_{12}M^{+}_{11}d_{1})+N(\tilde{M}_{11}(\lambda^{0}))\bigg{)}\cap W$$

   $$u^{0}(w^{0}) \in-M_{11}^{+}(M_{12}\;w^{0}+d_{1})+N(M_{11})$$

   where $\lambda^{0}$ must be computed from the following nonlinear optimization problem

   $$\lambda^{0}=\arg\min_{\lambda\geq\left|M_{22}-M_{12}^{\prime}M_{11}^{+}M_{12}\right|}L(\lambda)$$

Proof.

Expand $V$ as

$$V(u,w)=\frac{1}{2}u^{\prime}M_{11}u+u^{\prime}M_{12}w+\frac{1}{2}w^{\prime}M_{22}w+u^{\prime}d_{1}+w^{\prime}d_{2}$$

1. Note that from Proposition 7 the optimization problem

   $$\min_{u}\max_{w\in W}V(u,w)$$

   is equivalent to the Lagrangian problem

   $$\min_{u}\max_{w}\min_{\lambda}L(u,w,\lambda),\qquad L(u,w,\lambda):=V(u,w)-\frac{\lambda}{2}(w^{\prime}w-1)$$

   From Proposition 15 strong duality holds for $\max_{w}\min_{\lambda}L(u,w,\lambda)$, so the optimization problem is also equivalent to the dual Lagrangian problem

   $$\min_{\lambda}\min_{u}\max_{w}L(u,w,\lambda)$$

   but when we use the dual to obtain a solution set for the inner $\max_{w}$ problem, which gives $w^{0}(u,\lambda)$, that solution set may be too large. We fix this issue subsequently. From Proposition 14 a solution to $\min_{u}\max_{w}L(u,w,\lambda)$ exists if and only if $\lambda\geq\left|M_{22}\right|$ and the solution (set) and optimal value function are

   $$w^{0}(u,\lambda) \in-(M_{22}-\lambda I)^{+}(M_{12}^{\prime}\;u+d_{2})+N(M_{22}-\lambda I)$$

   $$u^{0}(\lambda) \in-\tilde{M}^{+}_{22}(\lambda)(d_{1}-M_{12}(M_{22}-\lambda I)^{+}d_{2})+N(\tilde{M}_{22}(\lambda))$$

   $$L(u^{0}(\lambda),w^{0}(u^{0},\lambda),\lambda) =\begin{cases}L(\lambda),\quad&\lambda\geq\left|M_{22}\right|\\ +\infty,\quad&\lambda<\left|M_{22}\right|\end{cases}$$

   The remaining optimization, which is equivalent to solving Eq. 48, is

   $$\min_{\lambda\geq\left|M_{22}\right|}L(\lambda)$$ (50)

   which establishes that

   $$\lambda^{0}:=\arg\min_{\lambda\geq\left|M_{22}\right|}L(\lambda)$$

   Substituting $\lambda^{0}$ in $u^{0}(\lambda)$, $w^{0}(u(\lambda))$, and $L(u^{0}(\lambda),w^{0}(u^{0},\lambda),\lambda)$ gives

   $$w^{0}(u) \in-(M_{22}-\lambda^{0}I)^{+}(M_{12}^{\prime}\;u+d_{2})+N(M_{22}-\lambda^{0}I)$$

   $$u^{0}(\lambda^{0}) \in\tilde{M}^{+}_{22}(\lambda^{0})(d_{1}-M_{12}(M_{22}-\lambda^{0}I)^{+}d_{2})+N(\tilde{M}_{22}(\lambda^{0}))$$

   $$L(u^{0},w^{0}(u^{0}),\lambda^{0}) =-(1/2)d^{\prime}M^{+}(\lambda^{0})d+\lambda^{0}/2$$

   Finally, restricting the dual solution $w^{0}(u^{0})$ to satisfy the constraint $w\in W$ by intersecting $w^{0}(u^{0})$ with $W$ giving

   $$w^{0}(u^{0})\in\bigg{(}-(M_{22}-\lambda^{0}I)^{+}(M_{12}^{\prime}\;u^{0}+d_{2})+N(M_{22}-\lambda I)\bigg{)}\cap W$$

   Since the constraint is satisfied, $L(u^{0},w^{0}(u^{0}),\lambda^{0})=V(u^{0},w^{0}(u^{0}))$ giving

   $$V(u^{0},w^{0}(u^{0}))=-(1/2)d^{\prime}M^{+}(\lambda^{0})d+\lambda^{0}/2$$

   and part 1 is established.

2. From Proposition 7 the optimization problem

   $$\max_{w\in W}\min_{u}V(u,w)$$

   is equivalent to the Lagrangian minmax problem

   $$\max_{w}\min_{\lambda}\min_{u}L(u,w,\lambda)$$

   Unlike the previous part, before we can use Proposition 15 and invoke strong duality, we must first examine the form of the innermost problem $\min_{u}L(u,w,\lambda)$. Using Proposition 5 to solve the $\min_{u}L(u,w,\lambda)$ problem and evaluating at the optimal $u$ gives

   $$L(u^{0}(w,\lambda),w,\lambda)=\frac{1}{2}w^{\prime}\tilde{M}_{11}(\lambda)w+w^{\prime}(d_{2}-M_{12}^{\prime}M_{11}^{+}d_{1})-\frac{1}{2}d_{1}^{\prime}M_{11}^{+}d_{1}+\frac{\lambda}{2}$$

   Given the functional form of $w$ and $\lambda$ above, we see that Proposition 15 indeed applies, and the optimization problem (49) is also equivalent to the dual Lagrangian problem

   $$\min_{\lambda}\max_{w}\min_{u}L(u,w,\lambda)$$

   Again, using the dual to obtain the solution for the inner $\max_{w}$ problem, which gives $w^{0}(\lambda)$, may give a solution set that is too large, and we further restrict that set subsequently. From Proposition 14 a solution to $\max_{w}\min_{u}L(u,w,\lambda)$ exists if and only if $\lambda\geq\left|M_{22}-M^{\prime}_{12}M^{+}_{11}M_{12}\right|$ and the solution (set) and optimal value function are

   $$u^{0}(w,\lambda) \in-M_{11}^{+}(M_{12}\;w+d_{1})+N(M_{11})$$

   $$w^{0}(\lambda) \in-\tilde{M}^{+}_{11}(\lambda)(d_{2}-M^{\prime}_{12}M^{+}_{11}d_{1})+N(\tilde{M}_{11}(\lambda))$$

   $$L(u^{0}(w^{0},\lambda),w^{0}(\lambda),\lambda) =\begin{cases}L(\lambda),\quad&\lambda\geq\left|M_{22}-M_{12}^{\prime}M_{11}^{+}M_{12}\right|\\ +\infty,\quad&\lambda<\left|M_{22}-M_{12}^{\prime}M_{11}^{+}M_{12}\right|\end{cases}$$

   The remaining optimization, which is equivalent to solving Eq. 49, is

   $$\min_{\lambda\geq\left|M_{22}-M_{12}^{\prime}M_{11}^{+}M_{12}\right|}L(\lambda)$$ (51)

   which establishes that

   $$\lambda^{0}:=\arg\min_{\lambda\geq\left|M_{22}-M_{12}^{\prime}M_{11}^{+}M_{12}\right|}L(\lambda)$$

   Restricting $w^{0}$ by enforcing the constraint $w^{0}\in W$ gives

   $$w^{0}(\lambda^{0})\in\bigg{(}-\tilde{M}^{+}_{11}(\lambda^{0})(d_{2}-M^{\prime}_{12}M^{+}_{11}d_{1})+N(\tilde{M}_{11}(\lambda^{0}))\bigg{)}\cap W$$

   Since the constraint is satisfied, $L(u^{0}(w^{0}),w^{0},\lambda)=V(u^{0}(w^{0}),w^{0})$ giving

   $$V(u^{0}(w^{0}),w^{0})=-(1/2)d^{\prime}M^{+}(\lambda^{0})d+\lambda^{0}/2$$

   and part 2 is established. ∎

To prove Corollary 19, note that $d=0$ so that Eq. 50 and Eq. 51 can be solved analytically giving $\lambda^{0}=\left|M_{22}\right|$ for Eq. 50 and $\lambda^{0}=\left|M_{22}-M_{12}^{\prime}M_{11}^{+}M_{12}\right|$ for Eq. 51. Substituting these $\lambda^{0}$ values and $d=0$ into the statement of Proposition 20 then establishes the results of Corollary 19.