-
A provably convergent alternating minimization method for mean field inference
Authors:
Pierre Baqué,
Jean-Hubert Hours,
François Fleuret,
Pascal Fua
Abstract:
Mean-Field is an efficient way to approximate a posterior distribution in complex graphical models and constitutes the most popular class of Bayesian variational approximation methods. In most applications, the mean field distribution parameters are computed using an alternate coordinate minimization. However, the convergence properties of this algorithm remain unclear. In this paper, we show how,…
▽ More
Mean-Field is an efficient way to approximate a posterior distribution in complex graphical models and constitutes the most popular class of Bayesian variational approximation methods. In most applications, the mean field distribution parameters are computed using an alternate coordinate minimization. However, the convergence properties of this algorithm remain unclear. In this paper, we show how, by adding an appropriate penalization term, we can guarantee convergence to a critical point, while kee** a closed form update at each step. A convergence rate estimate can also be derived based on recent results in non-convex optimization.
△ Less
Submitted 20 February, 2015;
originally announced February 2015.
-
An Alternating Trust Region Algorithm for Distributed Linearly Constrained Nonlinear Programs, Application to the AC Optimal Power Flow
Authors:
Jean-Hubert Hours,
Colin N. Jones
Abstract:
A novel trust region method for solving linearly constrained nonlinear programs is presented. The proposed technique is amenable to a distributed implementation, as its salient ingredient is an alternating projected gradient sweep in place of the Cauchy point computation. It is proven that the algorithm yields a sequence that globally converges to a critical point. As a result of some changes to t…
▽ More
A novel trust region method for solving linearly constrained nonlinear programs is presented. The proposed technique is amenable to a distributed implementation, as its salient ingredient is an alternating projected gradient sweep in place of the Cauchy point computation. It is proven that the algorithm yields a sequence that globally converges to a critical point. As a result of some changes to the standard trust region method, namely a proximal regularisation of the trust region subproblem, it is shown that the local convergence rate is linear with an arbitrarily small ratio. Thus, convergence is locally almost superlinear, under standard regularity assumptions. The proposed method is successfully applied to compute local solutions to alternating current optimal power flow problems in transmission and distribution networks. Moreover, the new mechanism for computing a Cauchy point compares favourably against the standard projected search as for its activity detection properties.
△ Less
Submitted 1 August, 2015; v1 submitted 12 February, 2015;
originally announced February 2015.
-
A Parametric Non-Convex Decomposition Algorithm for Real-Time and Distributed NMPC
Authors:
Jean-Hubert Hours,
Colin N. Jones
Abstract:
A novel decomposition scheme to solve parametric non-convex programs as they arise in Nonlinear Model Predictive Control (NMPC) is presented. It consists of a fixed number of alternating proximal gradient steps and a dual update per time step. Hence, the proposed approach is attractive in a real-time distributed context. Assuming that the Nonlinear Program (NLP) is semi-algebraic and that its crit…
▽ More
A novel decomposition scheme to solve parametric non-convex programs as they arise in Nonlinear Model Predictive Control (NMPC) is presented. It consists of a fixed number of alternating proximal gradient steps and a dual update per time step. Hence, the proposed approach is attractive in a real-time distributed context. Assuming that the Nonlinear Program (NLP) is semi-algebraic and that its critical points are strongly regular, contraction of the sequence of primal-dual iterates is proven, implying stability of the sub-optimality error, under some mild assumptions. Moreover, it is shown that the performance of the optimality-tracking scheme can be enhanced via a continuation technique. The efficacy of the proposed decomposition method is demonstrated by solving a centralised NMPC problem to control a DC motor and a distributed NMPC program for collaborative tracking of unicycles, both within a real-time framework. Furthermore, an analysis of the sub-optimality error as a function of the sampling period is proposed given a fixed computational power.
△ Less
Submitted 24 December, 2014; v1 submitted 21 August, 2014;
originally announced August 2014.
-
A Parametric Multi-Convex Splitting Technique with Application to Real-Time NMPC
Authors:
Jean-Hubert Hours,
Colin N. Jones
Abstract:
A novel splitting scheme to solve parametric multiconvex programs is presented. It consists of a fixed number of proximal alternating minimisations and a dual update per time step, which makes it attractive in a real-time Nonlinear Model Predictive Control (NMPC) framework and for distributed computing environments. Assuming that the parametric program is semi-algebraic and that its KKT points are…
▽ More
A novel splitting scheme to solve parametric multiconvex programs is presented. It consists of a fixed number of proximal alternating minimisations and a dual update per time step, which makes it attractive in a real-time Nonlinear Model Predictive Control (NMPC) framework and for distributed computing environments. Assuming that the parametric program is semi-algebraic and that its KKT points are strongly regular, a contraction estimate is derived and it is proven that the sub-optimality error remains stable if two key parameters are tuned properly. Efficacy of the method is demonstrated by solving a bilinear NMPC problem to control a DC motor.
△ Less
Submitted 21 July, 2014;
originally announced July 2014.
-
An Augmented Lagrangian Coordination-Decomposition Algorithm for Solving Distributed Non-Convex Programs
Authors:
Jean-Hubert Hours,
Colin N. Jones
Abstract:
A novel augmented Lagrangian method for solving non-convex programs with nonlinear cost and constraint couplings in a distributed framework is presented. The proposed decomposition algorithm is made of two layers: The outer level is a standard multiplier method with penalty on the nonlinear equality constraints, while the inner level consists of a block-coordinate descent (BCD) scheme. Based on st…
▽ More
A novel augmented Lagrangian method for solving non-convex programs with nonlinear cost and constraint couplings in a distributed framework is presented. The proposed decomposition algorithm is made of two layers: The outer level is a standard multiplier method with penalty on the nonlinear equality constraints, while the inner level consists of a block-coordinate descent (BCD) scheme. Based on standard results on multiplier methods and recent results on proximal regularised BCD techniques, it is proven that the method converges to a KKT point of the non-convex nonlinear program under a semi-algebraicity assumption. Efficacy of the algorithm is demonstrated on a numerical example.
△ Less
Submitted 21 July, 2014;
originally announced July 2014.
-
Exciton photon strong-coupling regime for a single quantum dot in a microcavity
Authors:
Emmanuelle Peter,
Pascale Senellart,
David Martrou,
Aristide Lemaitre,
Jacqueline Bloch,
Julien Hours,
Jean-Michel Gerard
Abstract:
We report on the observation of the strong coupling regime between a single GaAs quantum dot and a microdisk optical mode. Photoluminescence is performed at various temperatures to tune the quantum dot exciton with respect to the optical mode. At resonance, we observe an anticrossing, signature of the strong coupling regime with a well resolved doublet. The Vacuum Rabi splitting amounts to 400 &…
▽ More
We report on the observation of the strong coupling regime between a single GaAs quantum dot and a microdisk optical mode. Photoluminescence is performed at various temperatures to tune the quantum dot exciton with respect to the optical mode. At resonance, we observe an anticrossing, signature of the strong coupling regime with a well resolved doublet. The Vacuum Rabi splitting amounts to 400 μeV and is twice as large as the individual linewidths.
△ Less
Submitted 3 December, 2004; v1 submitted 10 November, 2004;
originally announced November 2004.
