Showing 1–49 of 49 results for author: Chancelier, J

Multistage stochastic optimization of a mono-site hydrogen infrastructure by decomposition techniques

Authors: Raian Lefgoum, Sezin Afsar, Pierre Carpentier, Jean-Philippe Chancelier, Michel de Lara

Abstract: The development of hydrogen infrastructures requires to reduce their costs. In this paper, we develop a multistage stochastic optimization model for the management of a hydrogen infrastructure which consists of an electrolyser, a compressor and a storage to serve a transportation demand. This infrastructure is powered by three different sources: on-site photovoltaic panels (PV), renewable ene… ▽ More The development of hydrogen infrastructures requires to reduce their costs. In this paper, we develop a multistage stochastic optimization model for the management of a hydrogen infrastructure which consists of an electrolyser, a compressor and a storage to serve a transportation demand. This infrastructure is powered by three different sources: on-site photovoltaic panels (PV), renewable energy through a power purchase agreement (PPA) and the power grid. We consider uncertainties affecting on-site photovoltaic production and hydrogen demand. Renewable energy sources are emphasized in the hydrogen production process to ensure eligibility for a subsidy, which is awarded if the proportion of nonrenewable electricity usage stays under a predetermined threshold. We solve the multistage stochastic optimization problem using a decomposition method based on Lagrange duality. The numerical results indicate that the solution to this problem, formulated as a policy, achieves a small duality gap, thus proving the effectiveness of this approach. △ Less

Submitted 1 July, 2024; originally announced July 2024.

Learning with Fitzpatrick Losses

Authors: Seta Rakotomandimby, Jean-Philippe Chancelier, Michel de Lara, Mathieu Blondel

Abstract: Fenchel-Young losses are a family of convex loss functions, encompassing the squared, logistic and sparsemax losses, among others. Each Fenchel-Young loss is implicitly associated with a link function, for map** model outputs to predictions. For instance, the logistic loss is associated with the soft argmax link function. Can we build new loss functions associated with the same link function as… ▽ More Fenchel-Young losses are a family of convex loss functions, encompassing the squared, logistic and sparsemax losses, among others. Each Fenchel-Young loss is implicitly associated with a link function, for map** model outputs to predictions. For instance, the logistic loss is associated with the soft argmax link function. Can we build new loss functions associated with the same link function as Fenchel-Young losses? In this paper, we introduce Fitzpatrick losses, a new family of convex loss functions based on the Fitzpatrick function. A well-known theoretical tool in maximal monotone operator theory, the Fitzpatrick function naturally leads to a refined Fenchel-Young inequality, making Fitzpatrick losses tighter than Fenchel-Young losses, while maintaining the same link function for prediction. As an example, we introduce the Fitzpatrick logistic loss and the Fitzpatrick sparsemax loss, counterparts of the logistic and the sparsemax losses. This yields two new tighter losses associated with the soft argmax and the sparse argmax, two of the most ubiquitous output layers used in machine learning. We study in details the properties of Fitzpatrick losses and in particular, we show that they can be seen as Fenchel-Young losses using a modified, target-dependent generating function. We demonstrate the effectiveness of Fitzpatrick losses for label proportion estimation. △ Less

Submitted 23 May, 2024; originally announced May 2024.

Decomposition Methods for Dynamically Monotone Two-Time-Scale Stochastic Optimization Problems

Authors: Tristan Rigaut, Pierre Carpentier, Jean-Philippe Chancelier, Michel de Lara

Abstract: In energy management, it is common that strategic investment decisions (storage capacity, production units) are made at a slow time scale, whereas operational decisions (storage, production) are made at a fast time scale: for such problems, the total number of decision stages may be huge. In this paper, we consider multistage stochastic optimization problems with two time-scales, and we propose a… ▽ More In energy management, it is common that strategic investment decisions (storage capacity, production units) are made at a slow time scale, whereas operational decisions (storage, production) are made at a fast time scale: for such problems, the total number of decision stages may be huge. In this paper, we consider multistage stochastic optimization problems with two time-scales, and we propose a time block decomposition scheme to address them numerically. More precisely, our approach relies on two assumptions. On the one hand, we suppose slow time scale stagewise independence of the noise process: the random variables that occur during a slow time scale interval are independent of those at another slow time scale interval. This makes it possible to use Dynamic Programming at the slow time scale. On the other hand, we suppose a dynamically monotone property for the problem under consideration, which makes it possible to obtain bounds. Then, we present two algorithmic methods to compute upper and lower bounds for slow time scale Bellman value functions. Both methods rely respectively on primal and dual decomposition of the Bellman equation applied at the slow time scale. We assess the methods tractability and validate their efficiency by solving a battery management problem where the fast time scale operational decisions have an impact on the storage current capacity, hence on the strategic decisions to renew the battery at the slow time scale. △ Less

Submitted 7 March, 2023; originally announced March 2023.

Contributions on complexity bounds for Deterministic Partially Observed Markov Decision Process

Authors: Cyrille Vessaire, Jean-Philippe Chancelier, Michel de Lara, Pierre Carpentier, Alejandro Rodríguez-Martínez

Abstract: Markov Decision Processes (Mdps) form a versatile framework used to model a wide range of optimization problems. The Mdp model consists of sets of states, actions, time steps, rewards, and probability transitions. When in a given state and at a given time, the decision maker's action generates a reward and determines the state at the next time step according to the probability transition function.… ▽ More Markov Decision Processes (Mdps) form a versatile framework used to model a wide range of optimization problems. The Mdp model consists of sets of states, actions, time steps, rewards, and probability transitions. When in a given state and at a given time, the decision maker's action generates a reward and determines the state at the next time step according to the probability transition function. However, Mdps assume that the decision maker knows the state of the controlled dynamical system. Hence, when one needs to optimize controlled dynamical systems under partial observation, one often turns toward the formalism of Partially Observed Markov Decision Processes (Pomdp). Pomdps are often untractable in the general case as Dynamic Programming suffers from the curse of dimensionality. Instead of focusing on the general Pomdps, we present a subclass where transitions and observations map**s are deterministic: Deterministic Partially Observed Markov Decision Processes (Det-Pomdp). That subclass of problems has been studied by (Littman, 1996) and (Bonet, 2009). It was first considered as a limit case of Pomdps by Littman, mainly used to illustrate the complexity of Pomdps when considering as few sources of uncertainties as possible. In this paper, we improve on Littman's complexity bounds. We then introduce and study an even simpler class: Separated Det-Pomdps and give some new complexity bounds for this class. This new class of problems uses a property of the dynamics and observation to push back the curse of dimensionality. △ Less

Submitted 20 January, 2023; originally announced January 2023.

Differentiability and Regularization of Parametric Convex Value Functions in Stochastic Multistage Optimization

Authors: Adrien Le Franc, Jean-Philippe Chancelier, Pierre Carpentier, Michel de Lara

Abstract: In multistage decision problems, it is often the case that an initial strategic decision (such as investment) is followed by many operational ones (operating the investment). Such initial strategic decision can be seen as a parameter affecting a multistage decision problem. More generally, we study in this paper a standard multistage stochastic optimization problem depending on a parameter. When t… ▽ More In multistage decision problems, it is often the case that an initial strategic decision (such as investment) is followed by many operational ones (operating the investment). Such initial strategic decision can be seen as a parameter affecting a multistage decision problem. More generally, we study in this paper a standard multistage stochastic optimization problem depending on a parameter. When the parameter is fixed, Stochastic Dynamic Programming provides a way to compute the optimal value of the problem. Thus, the value function depends both on the state (as usual) and on the parameter. Our aim is to investigate on the possibility to efficiently compute gradients of the value function with respect to the parameter, when these objects exist. When nondifferentiable, we propose a regularization method based on the Moreau-Yosida envelope. We present a numerical test case from day-ahead power scheduling. △ Less

Submitted 6 February, 2023; v1 submitted 20 December, 2022; originally announced December 2022.

Time Consistency for Multistage Stochastic Optimization Problems under Constraints in Expectation

Authors: Pierre Carpentier, Jean-Philippe Chancelier, Michel de Lara

Abstract: We consider sequences-indexed by time (discrete stages)-of families of multistage stochastic optimization problems. At each time, the optimization problems in a family are parameterized by some quantities (initial states, constraint levels.. .). In this framework, we introduce an adapted notion of time consistent optimal solutions, that is, solutions that remain optimal after truncation of the pas… ▽ More We consider sequences-indexed by time (discrete stages)-of families of multistage stochastic optimization problems. At each time, the optimization problems in a family are parameterized by some quantities (initial states, constraint levels.. .). In this framework, we introduce an adapted notion of time consistent optimal solutions, that is, solutions that remain optimal after truncation of the past and that are optimal for any values of the parameters. We link this time consistency notion with the concept of state variable in Markov Decision Processes for a class of multistage stochastic optimization problems incorporating state constraints at the final time, either formulated in expectation or in probability. For such problems, when the primitive noise random process is stagewise independent and takes a finite number of values, we show that time consistent solutions can be obtained by considering a finite dimensional state variable. We illustrate our results on a simple dam management problem. △ Less

Submitted 29 August, 2022; originally announced August 2022.

Optimization of a domestic microgrid equipped with solar panel and battery: Model Predictive Control and Stochastic Dual Dynamic Programming approaches

Authors: François Pacaud, Pierre Carpentier, Jean-Philippe Chancelier, Michel de Lara

Abstract: In this study, a microgrid with storage (battery, hot water tank) and solar panel is considered. We benchmark two algorithms, MPC and SDDP, that yield online policies to manage the microgrid, and compare them with a rule based policy. Model Predictive Control (MPC) is a well-known algorithm which models the future uncertainties with a deterministic forecast. By contrast, Stochastic Dual Dynamic Pr… ▽ More In this study, a microgrid with storage (battery, hot water tank) and solar panel is considered. We benchmark two algorithms, MPC and SDDP, that yield online policies to manage the microgrid, and compare them with a rule based policy. Model Predictive Control (MPC) is a well-known algorithm which models the future uncertainties with a deterministic forecast. By contrast, Stochastic Dual Dynamic Programming (SDDP) models the future uncertainties as stagewise independent random variables with known probability distributions. We present a scheme, based on out-of-sample validation, to fairly compare the two online policies yielded by MPC and SDDP. Our numerical studies put to light that MPC and SDDP achieve significant gains compared to the rule based policy, and that SDDP overperforms MPC not only on average but on most of the out-of-sample assessment scenarios. △ Less

Submitted 16 May, 2022; originally announced May 2022.

Comments: arXiv admin note: substantial text overlap with arXiv:1801.06479

Daily Generation Scheduling : Decomposition Methods to Solve the Hydraulic Problems

Authors: Jean-Philippe Chancelier, A Renaud

Abstract: Short-term hydro-generation management poses a non-convex or even non-continuous optimization problem. For this reason, the problem of systematically obtaining feasible and economically satisfying solutions has not yet been completely solved. Two decomposition methods, which, as far as we know, have not been applied in this field, are here proposed : $\bullet$ the first is based on a decomposition… ▽ More Short-term hydro-generation management poses a non-convex or even non-continuous optimization problem. For this reason, the problem of systematically obtaining feasible and economically satisfying solutions has not yet been completely solved. Two decomposition methods, which, as far as we know, have not been applied in this field, are here proposed : $\bullet$ the first is based on a decomposition by prediction method and the coordination is a primal-dual relaxation algorithm, $\bullet$ handling the dynamic constraints by duality, the second achieves a price decomposition by an Augmented Lagrangian technique. Numerical tests show the efficiency of these algorithms. They will enable the process in use at Electricit{é} de France to be improved. △ Less

Submitted 11 April, 2022; originally announced April 2022.

Multistage Optimization of a Petroleum Production System with Material Balance Model

Authors: Cyrille Vessaire, Jean-Philippe Chancelier, Michel de Lara, Pierre Carpentier, Alejandro Rodríguez-Martínez, Anna Roberts

Abstract: In this paper, we propose a mathematical formulation for the management of an oil production network as a multistage optimization problem. The reservoir is modeled as a controlled dynamical system by using material balance equations. We use a dynamic programming algorithm to solve the optimization problem. Two numerical applications illustrate our work: the first one consists in optimizing the pro… ▽ More In this paper, we propose a mathematical formulation for the management of an oil production network as a multistage optimization problem. The reservoir is modeled as a controlled dynamical system by using material balance equations. We use a dynamic programming algorithm to solve the optimization problem. Two numerical applications illustrate our work: the first one consists in optimizing the production of a gas reservoir, whereas the second one tackles an oil reservoir with water injection. △ Less

Submitted 20 September, 2022; v1 submitted 4 January, 2022; originally announced January 2022.

The Capra-subdifferential of the l0 pseudonorm

Authors: Adrien Le Franc, Jean-Philippe Chancelier, Michel de Lara

Abstract: The l0 pseudonorm counts the nonzero coordinates of a vector. It is often used in optimization problems to enforce the sparsity of the solution. However, this function is nonconvex and noncontinuous, and optimization problems formulated with l0 in the objective function or in the constraints are hard to solve in general. Recently, a new family of coupling functions - called Capra (constant along p… ▽ More The l0 pseudonorm counts the nonzero coordinates of a vector. It is often used in optimization problems to enforce the sparsity of the solution. However, this function is nonconvex and noncontinuous, and optimization problems formulated with l0 in the objective function or in the constraints are hard to solve in general. Recently, a new family of coupling functions - called Capra (constant along primal rays) - has proved to induce relevant generalized Fenchel-Moreau conjugacies to handle the l0 pseudonorm. In particular, under a suitable choice of source norm on the Euclidean space used in the definition of the Capra coupling - the function l0 is Capra-subdifferentiable, hence is Capra-convex. In this article, we give explicit formulations for the Capra subdifferential of l0, when the source norm is a lp norm with p larger that 1. We illustrate our results with graphical visualizations of the Capra subdifferential of l0 for the Euclidean source norm. △ Less

Submitted 18 August, 2022; v1 submitted 31 December, 2021; originally announced December 2021.

Causal Inference Theory with Information Dependency Models

Authors: Benjamin Heymann, Michel de Lara, Jean-Philippe Chancelier

Abstract: Inferring the potential consequences of an unobserved event is a fundamental scientific question. To this end, Pearl's celebrated do-calculus provides a set of inference rules to derive an interventional probability from an observational one. In this framework, the primitive causal relations are encoded as functional dependencies in a Structural Causal Model (SCM), which are generally mapped into… ▽ More Inferring the potential consequences of an unobserved event is a fundamental scientific question. To this end, Pearl's celebrated do-calculus provides a set of inference rules to derive an interventional probability from an observational one. In this framework, the primitive causal relations are encoded as functional dependencies in a Structural Causal Model (SCM), which are generally mapped into a Directed Acyclic Graph (DAG) in the absence of cycles. In this paper, by contrast, we capture causality without reference to graphs or functional dependencies, but with information fields and Witsenhausen's intrinsic model. The three rules of do-calculus reduce to a unique sufficient condition for conditional independence, the topological separation, which presents interesting theoretical and practical advantages over the d-separation. With this unique rule, we can deal with systems that cannot be represented with DAGs, for instance systems with cycles and/or 'spurious' edges. We treat an example that cannot be handled-to the extent of our knowledge-with the tools of the current literature. We also explain why, in the presence of cycles, the theory of causal inference might require different tools, depending on whether the random variables are discrete or continuous. △ Less

Submitted 9 August, 2021; v1 submitted 6 August, 2021; originally announced August 2021.

Topological Conditional Separation

Authors: Michel de Lara, Jean-Philippe Chancelier, Benjamin Heymann

Abstract: Pearl's d-separation is a foundational notion to study conditional independence between random variables. We define the topological conditional separation and we show that it is equivalent to the d-separation, extended beyond acyclic graphs, be they finite or infinite. Pearl's d-separation is a foundational notion to study conditional independence between random variables. We define the topological conditional separation and we show that it is equivalent to the d-separation, extended beyond acyclic graphs, be they finite or infinite. △ Less

Submitted 6 August, 2021; originally announced August 2021.

Conditional Separation as a Binary Relation. A Coq Assisted Proof

Authors: Jean-Philippe Chancelier, Michel de Lara, Benjamin Heymann

Abstract: The concept of d-separation holds a pivotal role in causality theory, serving as a fundamental tool for deriving conditional independence properties from causal graphs. Pearl defined the d-separation of two subsets conditionally on a third one. In this study, we present a novel perspective by showing i) how the d-separation can be extended beyond acyclic graphs, possibly infinite, and ii) how… ▽ More The concept of d-separation holds a pivotal role in causality theory, serving as a fundamental tool for deriving conditional independence properties from causal graphs. Pearl defined the d-separation of two subsets conditionally on a third one. In this study, we present a novel perspective by showing i) how the d-separation can be extended beyond acyclic graphs, possibly infinite, and ii) how it can be expressed and characterized as a binary relation between vertices. Compared to the typical perspectives in causality theory, our equivalence opens the door to more compact and computational proofing techniques, because the language of binary relations is well adapted to equational reasoning. Additionally, and of independent interest, the proofs of the results presented in this paper are checked with the Coq proof assistant. △ Less

Submitted 2 April, 2024; v1 submitted 6 August, 2021; originally announced August 2021.

Minimization Interchange Theorem on Posets

Authors: Jean-Philippe Chancelier, Michel de Lara, Benoît Tran

Abstract: Interchange theorems between minimization and integration are useful in optimization, especially in optimal control and in stochastic optimization. In this article, we establish a generalized minimization interchange theorem, where integration is replaced by a monotone map** between posets (partially ordered sets). As an application, we recover, and slightly extend, classical results from the li… ▽ More Interchange theorems between minimization and integration are useful in optimization, especially in optimal control and in stochastic optimization. In this article, we establish a generalized minimization interchange theorem, where integration is replaced by a monotone map** between posets (partially ordered sets). As an application, we recover, and slightly extend, classical results from the literature, and we tackle the case of the Choquet integral. Our result provides insight on the mechanisms behind existing interchange results. △ Less

Submitted 13 July, 2021; originally announced July 2021.

Decentralized Multistage Optimization of Large-Scale Microgrids under Stochasticity

Authors: François Pacaud, Michel de Lara, Jean-Philippe Chancelier, Pierre Carpentier

Abstract: Microgrids are recognized as a relevant tool to absorb decentralized renewable energies in the energy mix. However, the sequential handling of multiple stochastic productions and demands, and of storage, make their management a delicate issue. We add another layer of complexity by considering microgrids where different buildings stand at the nodes of a network and are connected by the arcs; some b… ▽ More Microgrids are recognized as a relevant tool to absorb decentralized renewable energies in the energy mix. However, the sequential handling of multiple stochastic productions and demands, and of storage, make their management a delicate issue. We add another layer of complexity by considering microgrids where different buildings stand at the nodes of a network and are connected by the arcs; some buildings host local production and storage capabilities, and can exchange with others their energy surplus. We formulate the problem as a multistage stochastic optimization problem, corresponding to the minimization of the expected temporal sum of operational costs, while satisfying the energy demand at each node, for all time. The resulting mathematical problem has a large-scale nature, exhibiting both spatial and temporal couplings. However, the problem displays a network structure that makes it amenable to a mix of spatial decomposition-coordination with temporal decomposition methods. We conduct numerical simulations on microgrids of different sizes and topologies, with up to 48 nodes and 64 state variables. Decomposition methods are faster and provide more efficient policies than a state-of-the-art Stochastic Dual Dynamic Programming algorithm. Moreover, they scale almost linearly with the state dimension, making them a promising tool to address more complex microgrid optimal management problems. △ Less

Submitted 8 June, 2021; originally announced June 2021.

Comments: arXiv admin note: substantial text overlap with arXiv:1912.10902

Decomposition-Coordination Method for Finite Horizon Bandit Problems

Authors: Michel de Lara, Benjamin Heymann, Jean-Philippe Chancelier

Abstract: Optimally solving a multi-armed bandit problem suffers the curse of dimensionality. Indeed, resorting to dynamic programming leads to an exponential growth of computing time, as the number of arms and the horizon increase. We introduce a decompositioncoordination heuristic, DeCo, that turns the initial problem into parallelly coordinated one-armed bandit problems. As a consequence, we obtain a com… ▽ More Optimally solving a multi-armed bandit problem suffers the curse of dimensionality. Indeed, resorting to dynamic programming leads to an exponential growth of computing time, as the number of arms and the horizon increase. We introduce a decompositioncoordination heuristic, DeCo, that turns the initial problem into parallelly coordinated one-armed bandit problems. As a consequence, we obtain a computing time which is essentially linear in the number of arms. In addition, the decomposition provides a theoretical lower bound on the regret. For the two-armed bandit case, dynamic programming provides the exact solution, which is almost matched by the DeCo heuristic. Moreover, in numerical simulations with up to 100 rounds and 20 arms, DeCo outperforms classic algorithms (Thompson sampling and Kullback-Leibler upper-confidence bound) and almost matches the theoretical lower bound on the regret for 20 arms. △ Less

Submitted 21 May, 2024; v1 submitted 2 June, 2021; originally announced June 2021.

Best Convex Lower Approximations of the l 0 Pseudonorm on Unit Balls

Authors: Thomas Bittar, Jean-Philippe Chancelier, Michel de Lara

Abstract: Whereas the norm of a vector measures amplitude (and is a 1-homogeneous function), sparsity is measured by the 0-homogeneous l0 pseudonorm, which counts the number of nonzero components. We propose a family of conjugacies suitable for the analysis of 0-homogeneous functions. These conjugacies are derived from couplings between vectors, given by their scalar product divided by a 1-homogeneous norma… ▽ More Whereas the norm of a vector measures amplitude (and is a 1-homogeneous function), sparsity is measured by the 0-homogeneous l0 pseudonorm, which counts the number of nonzero components. We propose a family of conjugacies suitable for the analysis of 0-homogeneous functions. These conjugacies are derived from couplings between vectors, given by their scalar product divided by a 1-homogeneous normalizing factor. With this, we characterize the best convex lower approximation of a 0-homogeneous function on the unit ''ball'' of a normalization function (i.e. a norm without the requirement of subadditivity). We do the same with the best convex and 1-homogeneous lower approximation. In particular, we provide expressions for the tightest convex lower approximation of the l0 pseudonorm on any unit ball, and we show that the tightest norm which minorizes the l0 pseudonorm on the unit ball of any lp-norm is the l1-norm. We also provide the tightest convex lower convex approximation of the l0 pseudonorm on the unit ball of any norm. △ Less

Submitted 31 May, 2021; originally announced May 2021.

Rank-Based Norms, Capra-Conjugacies and the Rank Function

Authors: Paul Barbier, Jean-Philippe Chancelier, Michel de Lara, Valentin Paravy

Abstract: We consider the space of matrices, with given number of rows and of columns, equipped with the classic trace scalar product. With any matrix (source) norm, we associate a coupling, called Capra, between the space of matrices and itself. Then, we compute the Capra conjugate and biconjugate of the rank function. They are expressed in function of a sequence of rank-based norms, more precisely general… ▽ More We consider the space of matrices, with given number of rows and of columns, equipped with the classic trace scalar product. With any matrix (source) norm, we associate a coupling, called Capra, between the space of matrices and itself. Then, we compute the Capra conjugate and biconjugate of the rank function. They are expressed in function of a sequence of rank-based norms, more precisely generalized r-rank and dual r-rank matrix norms associated with the matrix source norm. We deduce a lower bound of the rank function given by a variational formula which involves the generalized r-rank norms. In the case of the Frobenius norm, we show that the rank function is equal to the variational formula. △ Less

Submitted 6 February, 2023; v1 submitted 31 May, 2021; originally announced May 2021.

Conditional Infimum and Hidden Convexity in Optimization

Authors: Jean-Philippe Chancelier, Michel de Lara

Abstract: Detecting hidden convexity is one of the tools to address nonconvex minimization problems. After giving a formal definition of hidden convexity, we introduce the notion of conditional infimum, as it will prove instrumental in detecting hidden convexity. We develop the theory of the conditional infimum, and we establish a tower property, relevant for minimization problems. Thus equipped, we provide… ▽ More Detecting hidden convexity is one of the tools to address nonconvex minimization problems. After giving a formal definition of hidden convexity, we introduce the notion of conditional infimum, as it will prove instrumental in detecting hidden convexity. We develop the theory of the conditional infimum, and we establish a tower property, relevant for minimization problems. Thus equipped, we provide a sufficient condition for hidden convexity in nonconvex minimization problems. We illustrate our result on nonconvex quadratic minimization problems. We conclude with perspectives for using the conditional infimum in relation to the so-called S-procedure, to couplings and conjugacies, and to lower bound convex programs. △ Less

Submitted 12 April, 2021; originally announced April 2021.

Kuhn's Equivalence Theorem for Games in Product Form

Authors: Benjamin Heymann, Michel de Lara, Jean-Philippe Chancelier

Abstract: We propose an alternative to the tree representation of extensive form games. Games in product form represent information with $σ$-fields over a product set, and do not require an explicit description of the play temporality, as opposed to extensive form games on trees. This representation encompasses games with a continuum of actions, randomness and players, as well as games for which the play or… ▽ More We propose an alternative to the tree representation of extensive form games. Games in product form represent information with $σ$-fields over a product set, and do not require an explicit description of the play temporality, as opposed to extensive form games on trees. This representation encompasses games with a continuum of actions, randomness and players, as well as games for which the play order cannot be determined in advance. We adapt and prove Kuhn's theorem-regarding equivalence between mixed and behavioral strategies under perfect recall-for games in product form with continuous action sets. △ Less

Submitted 13 July, 2022; v1 submitted 12 April, 2021; originally announced April 2021.

The stochastic Auxiliary Problem Principle in Banach spaces: measurability and convergence

Authors: Thomas Bittar, Pierre Carpentier, Jean-Philippe Chancelier, Jérôme Lonchampt

Abstract: The stochastic Auxiliary Problem Principle (APP) algorithm is a general Stochastic Approximation (SA) scheme that turns the resolution of an original optimization problem into the iterative resolution of a sequence of auxiliary problems. This framework has been introduced to design decomposition-coordination schemes but also encompasses many well-known SA algorithms such as stochastic gradient des… ▽ More The stochastic Auxiliary Problem Principle (APP) algorithm is a general Stochastic Approximation (SA) scheme that turns the resolution of an original optimization problem into the iterative resolution of a sequence of auxiliary problems. This framework has been introduced to design decomposition-coordination schemes but also encompasses many well-known SA algorithms such as stochastic gradient descent or stochastic mirror descent. We study the stochastic APP in the case where the iterates lie in a Banach space and we consider an additive error on the computation of the subgradient of the objective. In order to derive convergence results or efficiency estimates for a SA scheme, the iterates must be random variables. This is why we prove the measurability of the iterates of the stochastic APP algorithm. Then, we extend convergence results from the Hilbert space case to the Banach space case. Finally, we derive efficiency estimates for the function values taken at the averaged sequence of iterates or at the last iterate, the latter being obtained by adapting the concept of modified Fej{é}r monotonicity to our framework. △ Less

Submitted 20 May, 2022; v1 submitted 20 January, 2021; originally announced January 2021.

Constant Along Primal Rays Conjugacies and Generalized Convexity for Functions of the Support

Authors: Jean-Philippe Chancelier, Michel de Lara

Abstract: The support of a vector in R d is the set of indices with nonzero entries. Functions of the support have the property to be 0-homogeneous and, because of that, the Fenchel conjugacy fails to provide relevant analysis. In this paper, we define the coupling Capra between R d and itself by dividing the classic Fenchel scalar product coupling by a given (source) norm on R d. Our main result is that, w… ▽ More The support of a vector in R d is the set of indices with nonzero entries. Functions of the support have the property to be 0-homogeneous and, because of that, the Fenchel conjugacy fails to provide relevant analysis. In this paper, we define the coupling Capra between R d and itself by dividing the classic Fenchel scalar product coupling by a given (source) norm on R d. Our main result is that, when both the source norm and its dual norm are orthant-strictly monotonic, any nondecreasing finite-valued function of the support map** is Capra-convex, that is, is equal to its Capra-biconjugate (generalized convexity). We also establish that any such function is the composition of a proper convex lower semi continuous function on R d with the normalization map** on the unit sphere (hidden convexity), and that, when normalized, it admits a variational formulation, which involves a family of generalized local-K-support dual norms. △ Less

Submitted 23 October, 2020; originally announced October 2020.

Comments: arXiv admin note: text overlap with arXiv:2002.01314

Tropical Dynamic Programming for Lipschitz Multistage Stochastic Programming

Authors: Marianne Akian, Jean-Philippe Chancelier, Benoît Tran

Abstract: We present an algorithm called Tropical Dynamic Programming (TDP) which builds upper and lower approximations of the Bellman value functions in risk-neutral Multistage Stochastic Programming (MSP), with independent noises of finite supports. To tackle the curse of dimensionality, popular parametric variants of Approximate Dynamic Programming approximate the Bellman value function as linear combi… ▽ More We present an algorithm called Tropical Dynamic Programming (TDP) which builds upper and lower approximations of the Bellman value functions in risk-neutral Multistage Stochastic Programming (MSP), with independent noises of finite supports. To tackle the curse of dimensionality, popular parametric variants of Approximate Dynamic Programming approximate the Bellman value function as linear combinations of basis functions. Here, Tropical Dynamic Programming builds upper (resp. lower) approximations of a given value function as min-plus linear (resp. max-plus linear) combinations of "basic functions". At each iteration, TDP adds a new basic function to the current combination following a deterministic criterion introduced by Baucke, Downward and Zackeri in 2018 for a variant of Stochastic Dual Dynamic Programming. We prove, for every Lipschitz MSP, the asymptotic convergence of the generated approximating functions of TDP to the Bellman value functions on sets of interest. We illustrate this result on MSP with linear dynamics and polyhedral costs. △ Less

Submitted 20 October, 2020; originally announced October 2020.

Comments: 23 pages, 3 figures

Kuhn's Equivalence Theorem for Games in Intrinsic Form

Authors: Benjamin Heymann, Michel de Lara, Jean-Philippe Chancelier

Abstract: We state and prove Kuhn's equivalence theorem for a new representation of games, the intrinsic form. First, we introduce games in intrinsic form where information is represented by $σ$-fields over a product set. For this purpose, we adapt to games the intrinsic representation that Witsenhausen introduced in control theory. Those intrinsic games do not require an explicit description of the play te… ▽ More We state and prove Kuhn's equivalence theorem for a new representation of games, the intrinsic form. First, we introduce games in intrinsic form where information is represented by $σ$-fields over a product set. For this purpose, we adapt to games the intrinsic representation that Witsenhausen introduced in control theory. Those intrinsic games do not require an explicit description of the play temporality, as opposed to extensive form games on trees. Second, we prove, for this new and more general representation of games, that behavioral and mixed strategies are equivalent under perfect recall (Kuhn's theorem). As the intrinsic form replaces the tree structure with a product structure, the handling of information is easier. This makes the intrinsic form a new valuable tool for the analysis of games with information. △ Less

Submitted 26 June, 2020; originally announced June 2020.

A Decomposition Method by Interaction Prediction for the Optimization of Maintenance Scheduling

Authors: Jean-Philippe Chancelier, Thomas Bittar, Pierre Carpentier, J-Ph Chancelier, Jérôme Lonchampt

Abstract: Optimizing maintenance scheduling is a major issue to improve the performance of hydropower plants. We study a system of several physical components of the same family: either a set of turbines, a set of transformers or a set of generators. The components share a common stock of spare parts and experience random failures that occur according to known failure distributions. We seek a deterministic… ▽ More Optimizing maintenance scheduling is a major issue to improve the performance of hydropower plants. We study a system of several physical components of the same family: either a set of turbines, a set of transformers or a set of generators. The components share a common stock of spare parts and experience random failures that occur according to known failure distributions. We seek a deterministic preventive maintenance strategy that minimizes an expected cost depending on maintenance and forced outages of the system. The Auxiliary Problem Principle is used to decompose the original large-scale optimization problem into a sequence of independent subproblems of smaller dimension while ensuring their coordination. Each subproblem consists in optimizing the maintenance on a single component. Decomposition-coordination techniques are based on variational techniques but the maintenance optimization problem is a mixed-integer problem. Therefore, we relax the dynamics and the cost functions of the system. The resulting algorithm iteratively solves the subproblems on the relaxed system with a blackbox method and coordinates the components. Relaxation parameters have an important influence on the optimization and must be appropriately chosen. An admissible maintenance strategy is then derived from the resolution of the relaxed problem. We apply the decomposition algorithm on a system with 80 components. It outperforms the reference blackbox method applied directly on the original problem. △ Less

Submitted 6 May, 2021; v1 submitted 25 February, 2020; originally announced February 2020.

Capra-Convexity, Convex Factorization and Variational Formulations for the l0 Pseudonorm

Authors: Jean-Philippe Chancelier, Michel de Lara

Abstract: The so-called l0 pseudonorm, or cardinality function, counts the number of nonzero components of a vector. In this paper, we analyze the l0 pseudonorm by means of so-called Capra (constant along primal rays) conjugacies, for which the underlying source norm and its dual norm are both orthant-strictly monotonic (a notion that we formally introduce and that encompasses the lp norms, but for the ext… ▽ More The so-called l0 pseudonorm, or cardinality function, counts the number of nonzero components of a vector. In this paper, we analyze the l0 pseudonorm by means of so-called Capra (constant along primal rays) conjugacies, for which the underlying source norm and its dual norm are both orthant-strictly monotonic (a notion that we formally introduce and that encompasses the lp norms, but for the extreme ones). We obtain three main results. First, we show that the l0 pseudonorm is equal to its Capra-biconjugate, that is, is a Capra-convex function. Second, we deduce an unexpected consequence, that we call convex factorization: the l0 pseudonorm coincides, on the unit sphere of the source norm, with a proper convex lower semicontinuous function. Third, we establish a variational formulation for the l0 pseudonorm by means of generalized top-k dual~norms and k-support dual~norms (that we formally introduce). △ Less

Submitted 6 August, 2021; v1 submitted 31 January, 2020; originally announced February 2020.

Constant Along Primal Rays Conjugacies and the l0 Pseudonorm

Authors: Jean-Philippe Chancelier, Michel de Lara

Abstract: The so-called l0 pseudonorm on Rd counts the number of nonzero components of a vector. It is used in sparse optimization, either as criterion or in the constraints, to obtain solutions with few nonzero entries. For such problems, the Fenchel conjugacy fails to provide relevant analysis: indeed, the Fenchel conjugate of the characteristic function of the level sets of the l0 pseudonorm is minus inf… ▽ More The so-called l0 pseudonorm on Rd counts the number of nonzero components of a vector. It is used in sparse optimization, either as criterion or in the constraints, to obtain solutions with few nonzero entries. For such problems, the Fenchel conjugacy fails to provide relevant analysis: indeed, the Fenchel conjugate of the characteristic function of the level sets of the l0 pseudonorm is minus infinity, and the Fenchel biconjugate of the l0 pseudonorm is zero. In this paper, we display a class of conjugacies that are suitable for the l0 pseudonorm. For this purpose, we suppose given a (source) norm on Rd. With this norm, we define, on the one hand, a sequence of so-called coordinate-k norms and, on the other hand, a coupling between Rd and Rd , called Capra (constant along primal rays). Then, we provide formulas for the Capra-conjugate and biconjugate, and for the Capra subdifferentials, of functions of the l0 pseudonorm (hence, in particular, of the l0 pseudonorm itself and of the characteristic functions of its level sets), in terms of the coordinate-k norms. As an application, we provide a new family of lower bounds for the l0 pseudonorm, as a fraction between two norms, the denominator being any norm. △ Less

Submitted 1 June, 2021; v1 submitted 31 January, 2020; originally announced January 2020.

Orthant-Strictly Monotonic Norms, Generalized Top-k and k-Support Norms and the L0 Pseudonorm

Authors: Jean-Philippe Chancelier, Michel de Lara

Abstract: The so-called l0 pseudonorm on the Euclidean space Rd counts the number of nonzero components of a vector. We say that a sequence of norms is strictly increasingly graded (with respect to the l0 pseudonorm) if it is nondecreasing and that the sequence of norms of a vector~x becomes stationary exactly at the index l0(x). In this paper, with any (source) norm, we associate sequences of gen… ▽ More The so-called l0 pseudonorm on the Euclidean space Rd counts the number of nonzero components of a vector. We say that a sequence of norms is strictly increasingly graded (with respect to the l0 pseudonorm) if it is nondecreasing and that the sequence of norms of a vector~x becomes stationary exactly at the index l0(x). In this paper, with any (source) norm, we associate sequences of generalized top-k and k-support norms, and we also introduce the new class of orthant-strictly monotonic norms (that encompasses the lp norms, but for the extreme ones). Then, we show that an orthant-strictly monotonic source norm generates a sequence of generalized top-k norms which is strictly increasingly graded. With this, we provide a systematic way to generate sequences of norms with which the level sets of the l0 pseudonorm are expressed by means of the difference of two norms. Our results rely on the study of orthant-strictly monotonic norms. △ Less

Submitted 20 July, 2022; v1 submitted 28 January, 2020; originally announced January 2020.

EMSx: a numerical benchmark for energy management systems

Authors: Adrien Le Franc, Pierre Carpentier, Jean-Philippe Chancelier, Michel de Lara

Abstract: Inserting renewable energy in the electric grid in a decentralized manneris a key challenge of the energy transition. However, at local scale, both production and demand display erratic behavior, which makes it delicate to match them. It is the goal of Energy Management Systems (EMS) to achieve such balance at least cost. We present EMSx, a numerical benchmark for testing control algorithms for th… ▽ More Inserting renewable energy in the electric grid in a decentralized manneris a key challenge of the energy transition. However, at local scale, both production and demand display erratic behavior, which makes it delicate to match them. It is the goal of Energy Management Systems (EMS) to achieve such balance at least cost. We present EMSx, a numerical benchmark for testing control algorithms for the management of electric microgrids equipped with a photovoltaic unit and an energy storage system. EMSx is made of three key components: the EMSx dataset, provided by Schneider Electric, contains a diverse pool of realistic microgrids with a rich collection of historical observations and forecasts; the EMSx mathematical framework is an explicit description of the assessment of electric microgrid control techniques and algorithms; the EMSx software EMSx.jl is a package, implemented in the Julia language, which enables to easily implement a microgrid controller and to test it. All components of the benchmark are publicly available, so that other researchers willing to test controllers on EMSx may reproduce experiments easily. Eventually, we showcase the results of standard microgrid control methods, including Model Predictive Control, Open Loop Feedback Control and Stochastic Dynamic Programming. △ Less

Submitted 14 October, 2021; v1 submitted 2 January, 2020; originally announced January 2020.

Journal ref: Energy Systems, Springer, 2021

Upper and Lower Bounds for Large Scale Multistage Stochastic Optimization Problems: Application to Microgrid Management

Authors: Pierre Carpentier, Jean-Philippe Chancelier, Michel de Lara, François Pacaud

Abstract: We consider a microgrid where different prosumers exchange energy altogether by the edges of a given network. Each prosumer is located to a node of the network and encompasses energy consumption, energy production and storage capacities (battery, electrical hot water tank). The problem is coupled both in time and in space, so that a direct resolution of the problem for large microgrids is out of r… ▽ More We consider a microgrid where different prosumers exchange energy altogether by the edges of a given network. Each prosumer is located to a node of the network and encompasses energy consumption, energy production and storage capacities (battery, electrical hot water tank). The problem is coupled both in time and in space, so that a direct resolution of the problem for large microgrids is out of reach (curse of dimensionality). By affecting price or resources to each node in the network and resolving each nodal sub-problem independently by Dynamic Programming, we provide decomposition algorithms that allow to compute a set of decomposed local value functions in a parallel manner. By summing the local value functions together, we are able, on the one hand, to obtain upper and lower bounds for the optimal value of the problem, and, on the other hand, to design global admissible policies for the original system. Numerical experiments are conducted on microgrids of different size, derived from data given by the research and development centre Efficacity, dedicated to urban energy transition. These experiments show that the decomposition algorithms give better results than the standard SDDP method, both in terms of bounds and policy values. Moreover, the decomposition methods are much faster than the SDDP method in terms of computation time, thus allowing to tackle problem instances incorporating more than 60 state variables in a Dynamic Programming framework. △ Less

Submitted 23 December, 2019; originally announced December 2019.

Mixed Spatial and Temporal Decompositions for Large Scale Multistage Stochastic Optimization Problems

Authors: Pierre Carpentier, Jean-Philippe Chancelier, Michel de Lara, François Pacaud

Abstract: We consider multistage stochastic optimization problems involving multiple units. Each unit is a (small) control system. Static constraints couple units at each stage. We present a mix of spatial and temporal decompositions to tackle such large scale problems. More precisely, we obtain theoretical bounds and policies by means of two methods, depending whether the coupling constraints are handled b… ▽ More We consider multistage stochastic optimization problems involving multiple units. Each unit is a (small) control system. Static constraints couple units at each stage. We present a mix of spatial and temporal decompositions to tackle such large scale problems. More precisely, we obtain theoretical bounds and policies by means of two methods, depending whether the coupling constraints are handled by prices or by resources. We study both centralized and decentralized information structures. We report the results of numerical experiments on the management of urban microgrids. It appears that decomposition methods are much faster and give better results than the standard Stochastic Dual Dynamic Programming method, both in terms of bounds and of policy performance. △ Less

Submitted 17 June, 2021; v1 submitted 23 December, 2019; originally announced December 2019.

Hidden Convexity in the l0 Pseudonorm

Authors: Jean-Philippe Chancelier, Michel de Lara

Abstract: The so-called l0 pseudonorm counts the number of nonzero components of a vector of a Euclidian space. It is well-known that the l0 pseudonorm is not convex, as its Fenchel biconjugate is zero. In this paper, we introduce a suitable conjugacy, induced by a novel coupling, E-Capra, that has the property of being constant along primal rays like the l0 pseudonorm. The coupling E-Capra belongs to t… ▽ More The so-called l0 pseudonorm counts the number of nonzero components of a vector of a Euclidian space. It is well-known that the l0 pseudonorm is not convex, as its Fenchel biconjugate is zero. In this paper, we introduce a suitable conjugacy, induced by a novel coupling, E-Capra, that has the property of being constant along primal rays like the l0 pseudonorm. The coupling E-Capra belongs to the class of one-sided linear couplings, that we introduce; we show that they induce conjugacies that share nice properties with the classic Fenchel conjugacy. For the E-Capra conjugacy, induced by the coupling E-Capra, we relate the E-Capra conjugate and biconjugate of the l0 pseudonorm, the characteristic functions of its level sets and the sequence of so-called top-k norms. In particular, we prove that the l0 pseudonorm is equal to its biconjugate: hence, the l0 pseudonorm is E-Capra-convex in the sense of generalized convexity. As a corollary, we show that there exists a proper convex lower semicontinuous function such that this function and the l0 pseudonorm coincide on the Euclidian unit sphere. This hidden convexity property is somewhat surprising as the l0 pseudonorm is a highly nonconvex function of combinatorial nature. We provide different expressions for this proper convex lower semicontinuous function, and we give explicit formulas in the two-dimensional case. △ Less

Submitted 17 June, 2021; v1 submitted 7 June, 2019; originally announced June 2019.

Comments: arXiv admin note: text overlap with arXiv:1902.04816

A Suitable Conjugacy for the l0 Pseudonorm

Authors: Jean-Philippe Chancelier, Michel De Lara, Ponts Paristech

Abstract: The so-called l0 pseudonorm on R d counts the number of nonzero components of a vector. It is well-known that the l0 pseudonorm is not convex, as its Fenchel biconjugate is zero. In this paper, we introduce a suitable conjugacy, induced by a novel coupling, Caprac, having the property of being constant along primal rays, like the l0 pseudonorm. The Caprac coupling belongs to the class of one-sided… ▽ More The so-called l0 pseudonorm on R d counts the number of nonzero components of a vector. It is well-known that the l0 pseudonorm is not convex, as its Fenchel biconjugate is zero. In this paper, we introduce a suitable conjugacy, induced by a novel coupling, Caprac, having the property of being constant along primal rays, like the l0 pseudonorm. The Caprac coupling belongs to the class of one-sided linear couplings, that we introduce. We show that they induce conjugacies that share nice properties with the classic Fenchel conjugacy. For the Caprac conjugacy, induced by the coupling Caprac, we prove that the l0 pseudonorm is equal to its biconjugate: hence, the l0 pseudonorm is Caprac-convex in the sense of generalized convexity. As a corollary, we show that the l0 pseudonorm coincides, on the sphere, with a convex lsc function. We also provide expressions for conjugates in terms of two families of dual norms, the 2-k-symmetric gauge norms and the k-support norms. △ Less

Submitted 13 February, 2019; originally announced February 2019.

Comments: arXiv admin note: text overlap with arXiv:1902.04813

Lower Bound Convex Programs for Exact Sparse Optimization

Authors: Jean-Philippe Chancelier, Michel De Lara, Ponts Paristech

Abstract: In exact sparse optimization problems on Rd (also known as sparsity constrained problems), one looks for solution that have few nonzero components. In this paper, we consider problems where sparsity is exactly measured either by the nonconvex l0 pseudonorm (and not by substitute penalty terms) or by the belonging of the solution to a finite union of subsets. Due to the combinatorial nature of the… ▽ More In exact sparse optimization problems on Rd (also known as sparsity constrained problems), one looks for solution that have few nonzero components. In this paper, we consider problems where sparsity is exactly measured either by the nonconvex l0 pseudonorm (and not by substitute penalty terms) or by the belonging of the solution to a finite union of subsets. Due to the combinatorial nature of the sparsity constraint, such problems do not generally display convexity properties, even if the criterion to minimize is convex. In the most common approach to tackle them, one replaces the sparsity constraint by a convex penalty term, supposed to induce sparsity. Thus doing, one loses the original exact sparse optimization problem, but gains convexity. However, by doing so, it is not clear that one obtains a lower bound of the original exact sparse optimization problem. In this paper, we propose another approach, where we lose convexity but where we gain at kee** the original exact sparse optimization formulation, by displaying lower bound convex minimization programs. For this purpose , we introduce suitable conjugacies, induced by a novel class of one-sided linear couplings. Thus equipped, we present a systematic way to design norms and lower bound convex minimization programs over their unit ball. The family of norms that we display encompasses most of the sparsity inducing norms used in machine learning. Therefore, our approach provides foundation and interpretation for their use. △ Less

Submitted 13 February, 2019; originally announced February 2019.

A stochastic algorithm for deterministic multistage optimization problems

Authors: Marianne Akian, Jean-Philippe Chancelier, Benoît Tran

Abstract: Several attempts to dampen the curse of dimensionnality problem of the Dynamic Programming approach for solving multistage optimization problems have been investigated. One popular way to address this issue is the Stochastic Dual Dynamic Programming method (SDDP) introduced by Perreira and Pinto in 1991 for Markov Decision Processes. Assuming that the value function is convex (for a minimization p… ▽ More Several attempts to dampen the curse of dimensionnality problem of the Dynamic Programming approach for solving multistage optimization problems have been investigated. One popular way to address this issue is the Stochastic Dual Dynamic Programming method (SDDP) introduced by Perreira and Pinto in 1991 for Markov Decision Processes. Assuming that the value function is convex (for a minimization problem), one builds a non-decreasing sequence of lower (or outer) convex approximations of the value function. Those convex approximations are constructed as a supremum of affine cuts. On continuous time deterministic optimal control problems, assuming that the value function is semiconvex, Zheng Qu, inspired by the work of McEneaney, introduced in 2013 a stochastic max-plus scheme that builds upper (or inner) non-increasing approximations of the value function. In this note, we build a common framework for both the SDDP and a discrete time version of Zheng Qu's algorithm to solve deterministic multistage optimization problems. Our algorithm generates monotone approximations of the value functions as a pointwise supremum, or infimum, of basic (affine or quadratic for example) functions which are randomly selected. We give sufficient conditions on the way basic functions are selected in order to ensure almost sure convergence of the approximations to the value function on a set of interest. △ Less

Submitted 8 October, 2020; v1 submitted 30 October, 2018; originally announced October 2018.

Comments: 34 pages, 7 figures, submitted version

Fenchel-Moreau Conjugation Inequalities with Three Couplings and Application to Stochastic Bellman Equation

Authors: Jean-Philippe Chancelier, Michel De Lara

Abstract: Given two couplings between "primal" and "dual" sets, we prove a general implication that relates an inequality involving "primal" sets to a reverse inequality involving the "dual" sets.% More precisely, let be given two "primal" sets $\PRIMAL$, $\PRIMALBIS$and two "dual" sets $\DUAL$, $\DUALBIS$, together with two {coupling} functions \(\PRIMAL \overset{\coupling}{\leftrightarrow} \DUAL… ▽ More Given two couplings between "primal" and "dual" sets, we prove a general implication that relates an inequality involving "primal" sets to a reverse inequality involving the "dual" sets.% More precisely, let be given two "primal" sets $\PRIMAL$, $\PRIMALBIS$and two "dual" sets $\DUAL$, $\DUALBIS$, together with two {coupling} functions \(\PRIMAL \overset{\coupling}{\leftrightarrow} \DUAL \) and \(\PRIMALBIS \overset{\couplingbis}{\leftrightarrow} \DUALBIS \). We define a new coupling \(\SumCoupling{\coupling}{\couplingbis} \) between the "primal" product set~$\PRIMAL \times \PRIMALBIS$ and the "dual" product set $\DUAL \times \DUALBIS$. Then, we consider any bivariate function \(\kernel : \PRIMAL \times \PRIMALBIS \to \barRR \) and univariate functions \(\fonctionprimal : \PRIMAL \to \barRR \) and \(\fonctionprimalbis : \PRIMALBIS \to \barRR \), all defined on the "primal" sets. We prove that \(\fonctionprimal\np{\primal} \geq \inf\_{\primalbis \in \PRIMALBIS} \Bp{\kernel\np{\primal, \primalbis} \UppPlus \fonctionprimalbis\np{\primalbis}} \) \( \Rightarrow \SFM{\fonctionprimal}{\coupling}\np{\dual} \leq \inf\_{\dualbis \in \DUALBIS} \Bp{\SFM{\kernel}{\SumCoupling{\coupling}{\couplingbis}}\np{\dual,\dualbis} \UppPlus \SFM{\fonctionprimalbis}{-\couplingbis}\np{\dualbis}} \), where we stress that the Fenchel-Moreau conjugates \(\SFM{\fonctionprimal}{\coupling} \) and \(\SFM{\fonctionprimalbis}{-\couplingbis}\) are not necessarily taken with the same coupling. We study the equality case, after having established the classical Fenchel inequality but with a general coupling. % We display several applications. We provide a new formula for the Fenchel-Moreau conjugate of a generalized inf-convolution. We obtain formulas with partial Fenchel-Moreau conjugates. Finally, we consider the Bellman equation in stochastic dynamic programming and we provide a "Bellman-like" equation for the Fenchel conjugates of the value functions. △ Less

Submitted 10 September, 2018; v1 submitted 9 April, 2018; originally announced April 2018.

Time Blocks Decomposition of Multistage Stochastic Optimization Problems

Authors: Pierre Carpentier, Jean-Philippe Chancelier, Michel de Lara, Thomas Martin, Tristan Rigaut

Abstract: Multistage stochastic optimization problems are, by essence, complex as their solutions are indexed both by stages and by uncertainties. Their large scale nature makes decomposition methods appealing, like dynamic programming which is a sequential decomposition using a state variable defined at all stages. In this paper, we introduce the notion of state reduction by time blocks, that is, at… ▽ More Multistage stochastic optimization problems are, by essence, complex as their solutions are indexed both by stages and by uncertainties. Their large scale nature makes decomposition methods appealing, like dynamic programming which is a sequential decomposition using a state variable defined at all stages. In this paper, we introduce the notion of state reduction by time blocks, that is, at stages that are not necessarily all the original stages. Then, we prove a reduced dynamic programming equation. We position our result with respect to the most well-known mathematical frameworks for dynamic programming. We illustrate our contribution by showing its potential for applied problems with two time scales. △ Less

Submitted 28 April, 2023; v1 submitted 5 April, 2018; originally announced April 2018.

Stochastic optimal control of a domestic microgrid equipped with solar panel and battery

Authors: François Pacaud, Pierre Carpentier, Jean-Philippe Chancelier, Michel De Lara

Abstract: Microgrids are integrated systems that gather and operate energy production units to satisfy consumers demands. This paper details different mathematical methods to design the Energy Management System (EMS) of domestic microgrids. We consider different stocks coupled together - a battery, a domestic hot water tank - and decentralized energy production with solar panel. The main challenge of the EM… ▽ More Microgrids are integrated systems that gather and operate energy production units to satisfy consumers demands. This paper details different mathematical methods to design the Energy Management System (EMS) of domestic microgrids. We consider different stocks coupled together - a battery, a domestic hot water tank - and decentralized energy production with solar panel. The main challenge of the EMS is to ensure, at least cost, that supply matches demand for all time, while considering the inherent uncertainties of such systems. We benchmark two optimization algorithms to manage the EMS, and compare them with a heuristic. The Model Predictive Control (MPC) is a well known algorithm which models the future uncertainties with a deterministic forecast. By contrast, Stochastic Dual Dynamic Programming (SDDP) models the future uncertainties as probability distributions to compute optimal policies. We present a fair comparison of these two algorithms to control microgrid. A comprehensive numerical study shows that i) optimization algorithms achieve significant gains compared to the heuristic, ii) SDDP outperforms MPC by a few percents, with a reasonable computational overhead. △ Less

Submitted 19 January, 2018; originally announced January 2018.

Stochastic Optimization of Braking Energy Storage and Ventilation in a Subway Station

Authors: Tristan Rigaut, Pierre Carpentier, Jean Philippe Chancelier, Michel De Lara, Julien Waeytens

Abstract: In the Paris subway system, stations represent about one third of the overall energy consumption. Within stations, ventilation is among the top consuming devices; it is operated at maximum airflow all day long, for air quality reasons. In this paper, we present a concept of energy system that displays comparable air quality while consuming much less energy. The system comprises a battery that make… ▽ More In the Paris subway system, stations represent about one third of the overall energy consumption. Within stations, ventilation is among the top consuming devices; it is operated at maximum airflow all day long, for air quality reasons. In this paper, we present a concept of energy system that displays comparable air quality while consuming much less energy. The system comprises a battery that makes it possible to recover the trains braking energy, arriving under the form of erratic and strong peaks. We propose an energy management system (EMS) that, at short time scale, controls energy flows and ventilation airflow. By using proper optimization algorithms, we manage to match supply with demand, while minimizing energy daily costs. For this purpose, we have designed algorithms that take into account the braking variability. They are based on the so-called Stochastic Dynamic Programming (SDP) mathematical framework. We fairly compare SDP based algorithms with the widespread Model Predictive Control (MPC) ones. First, both SDP and MPC yield energy/money operating savings of the order of one third, compared to the current management without battery (our figure does not include the cost of the battery). Second, depending on the specific design, we observe that SDP outperforms MPC by a few percent, with an easier online numerical implementation. △ Less

Submitted 22 February, 2018; v1 submitted 9 January, 2018; originally announced January 2018.

Equivalence Between Time Consistency and Nested Formula

Authors: Henri Gérard, Michel de Lara, Jean-Philippe Chancelier

Abstract: You are a financial analyst. At the beginning of every week, you are able to rank every pair of stochastic processes starting from that week up to the horizon. Suppose that two processes are equal at the beginning of the week. Your ranking procedure is time consistent if the ranking does not change between this week and the next one. In this paper, we propose a minimalist definition of Time Consis… ▽ More You are a financial analyst. At the beginning of every week, you are able to rank every pair of stochastic processes starting from that week up to the horizon. Suppose that two processes are equal at the beginning of the week. Your ranking procedure is time consistent if the ranking does not change between this week and the next one. In this paper, we propose a minimalist definition of Time Consistency (TC) between two (assessment) map**s. With very few assumptions, we are able to prove an equivalence between Time Consistency and a Nested Formula (NF) between the two map**s. Thus, in a sense, two assessments are consistent if and only if one is factored into the other. We review the literature and observe that the various definitions of TC (or of NF) are special cases of ours, as they always include additional assumptions. By strip** off these additional assumptions, we present an overview of the literature where the contribution of each author is enlightened. △ Less

Submitted 17 May, 2019; v1 submitted 23 November, 2017; originally announced November 2017.

Stochastic decomposition applied to large-scale hydro valleys management

Authors: François Pacaud, Pierre Carpentier, Jean-Philippe Chancelier, Vincent Leclère

Abstract: We are interested in optimally controlling a discrete time dynamical system that can be influenced by exogenous uncertainties. This is generally called a Stochas-tic Optimal Control (SOC) problem and the Dynamic Programming (DP) principle is one of the standard way of solving it. Unfortunately, DP faces the so-called curse of dimensionality: the complexity of solving DP equations grows exponential… ▽ More We are interested in optimally controlling a discrete time dynamical system that can be influenced by exogenous uncertainties. This is generally called a Stochas-tic Optimal Control (SOC) problem and the Dynamic Programming (DP) principle is one of the standard way of solving it. Unfortunately, DP faces the so-called curse of dimensionality: the complexity of solving DP equations grows exponentially with the dimension of the variable that is sufficient to take optimal decisions (the so-called state variable). For a large class of SOC problems, which includes important practical applications in energy management, we propose an original way of obtaining near optimal controls. The algorithm we introduce is based on Lagrangian relaxation, of which the application to decomposition is well-known in the deterministic framework. However, its application to such closed-loop problems is not straightforward and an additional statistical approximation concerning the dual process is needed. The resulting methodology is called Dual Approximate Dynamic Programming (DADP). We briefly present DADP, give interpretations and enlighten the error induced by the approximation. The paper is mainly devoted to applying DADP to the management of large hydro valleys. The modeling of such systems is presented, as well as the practical implementation of the methodology. Numerical results are provided on several valleys, and we compare our approach with the state of the art SDDP method. △ Less

Submitted 24 May, 2017; originally announced May 2017.

A novel code generation methodology for block diagram modeler and simulators Scicos and VSS

Authors: Jean-Philippe Chancelier, Ramine Nikoukhah

Abstract: Block operations during simulation in Scicos and VSS environments can naturally be described as Nsp functions. But the direct use of Nsp functions for simulation leads to poor performance since the Nsp language is interpreted, not compiled. The methodology presented in this paper is used to develop a tool for generating efficient compilable code, such as C and ADA, for Scicos and VSS models from t… ▽ More Block operations during simulation in Scicos and VSS environments can naturally be described as Nsp functions. But the direct use of Nsp functions for simulation leads to poor performance since the Nsp language is interpreted, not compiled. The methodology presented in this paper is used to develop a tool for generating efficient compilable code, such as C and ADA, for Scicos and VSS models from these block Nsp functions. Operator overloading and partial evaluation are the key elements of this novel approach. This methodology may be used in other simulation environments such as Matlab/Simulink. △ Less

Submitted 8 October, 2015; originally announced October 2015.

Auxiliary problem principle and inexact variable metric forward-backward algorithm for minimizing the sum of a differentiable function and a convex function

Authors: Jean-Philippe Chancelier

Abstract: In view of the minimization of a function which is the sum of a differentiable function $f$ and a convex function $g$ we introduce descent methods which can be viewed as produced by inexact auxiliary problem principleor inexact variable metric forward-backward algorithm. Assuming that the global objective function satisfies the Kurdyka-Lojasiewicz inequalitywe prove the convergence of the propose… ▽ More In view of the minimization of a function which is the sum of a differentiable function $f$ and a convex function $g$ we introduce descent methods which can be viewed as produced by inexact auxiliary problem principleor inexact variable metric forward-backward algorithm. Assuming that the global objective function satisfies the Kurdyka-Lojasiewicz inequalitywe prove the convergence of the proposed algorithm weakening assumptions found in previous works. △ Less

Submitted 10 September, 2016; v1 submitted 12 August, 2015; originally announced August 2015.

Comments: This paper has been withdrawn by the author due to crucial error in Lemma 4

Extensions and applications of ACF map**s

Authors: Jean-Philippe Chancelier

Abstract: Using a definition of ASF sequences derived from the definition of asymptotic contractions of the final type of ACF, we give some new fixed points theorem for cyclic map**s and alternating map** which extend results from T.Suzuki and X.Zhang. Using a definition of ASF sequences derived from the definition of asymptotic contractions of the final type of ACF, we give some new fixed points theorem for cyclic map**s and alternating map** which extend results from T.Suzuki and X.Zhang. △ Less

Submitted 4 April, 2013; v1 submitted 15 November, 2011; originally announced November 2011.

Dynamic consistency for Stochastic Optimal Control problems

Authors: Pierre Carpentier, Jean-Philippe Chancelier, Guy Cohen, Michel De Lara, Pierre Girardeau

Abstract: For a sequence of dynamic optimization problems, we aim at discussing a notion of consistency over time. This notion can be informally introduced as follows. At the very first time step $t_0$, the decision maker formulates an optimization problem that yields optimal decision rules for all the forthcoming time step $t_0, t_1, ..., T$; at the next time step $t_1$, he is able to formulate a new optim… ▽ More For a sequence of dynamic optimization problems, we aim at discussing a notion of consistency over time. This notion can be informally introduced as follows. At the very first time step $t_0$, the decision maker formulates an optimization problem that yields optimal decision rules for all the forthcoming time step $t_0, t_1, ..., T$; at the next time step $t_1$, he is able to formulate a new optimization problem starting at time $t_1$ that yields a new sequence of optimal decision rules. This process can be continued until final time $T$ is reached. A family of optimization problems formulated in this way is said to be time consistent if the optimal strategies obtained when solving the original problem remain optimal for all subsequent problems. The notion of time consistency, well-known in the field of Economics, has been recently introduced in the context of risk measures, notably by Artzner et al. (2007) and studied in the Stochastic Programming framework by Shapiro (2009) and for Markov Decision Processes (MDP) by Ruszczynski (2009). We here link this notion with the concept of "state variable" in MDP, and show that a significant class of dynamic optimization problems are dynamically consistent, provided that an adequate state variable is chosen. △ Less

Submitted 20 May, 2010; originally announced May 2010.

Using Premia and Nsp for Constructing a Risk Management Benchmark for Testing Parallel Architecture

Authors: Jean-Philippe Chancelier, Jérôme Lelong, Bernard Lapeyre

Abstract: Financial institutions have massive computations to carry out overnight which are very demanding in terms of the consumed CPU. The challenge is to price many different products on a cluster-like architecture. We have used the Premia software to valuate the financial derivatives. In this work, we explain how Premia can be embedded into Nsp, a scientific software like Matlab, to provide a powerful t… ▽ More Financial institutions have massive computations to carry out overnight which are very demanding in terms of the consumed CPU. The challenge is to price many different products on a cluster-like architecture. We have used the Premia software to valuate the financial derivatives. In this work, we explain how Premia can be embedded into Nsp, a scientific software like Matlab, to provide a powerful tool to valuate a whole portfolio. Finally, we have integrated an MPI toolbox into Nsp to enable to use Premia to solve a bunch of pricing problems on a cluster. This unified framework can then be used to test different parallel architectures. △ Less

Submitted 21 May, 2012; v1 submitted 19 January, 2010; originally announced January 2010.

A note on strong convergence to common fixed points of nonexpansive map**s in Hilbert spaces

Authors: Jean-Philippe Chancelier

Abstract: The aim of this paper is to investigate the links between ${\cal T}_C$-class algorithms, CQ Algorithm and shrinking projection methods. We show that strong convergence of these algorithms are related to coherent ${\cal T}_C$-class sequences of map**. Some examples dealing with nonexpansive finite set of map**s and nonexpansive semigroups are given. They extend some existing theorems. The aim of this paper is to investigate the links between ${\cal T}_C$-class algorithms, CQ Algorithm and shrinking projection methods. We show that strong convergence of these algorithms are related to coherent ${\cal T}_C$-class sequences of map**. Some examples dealing with nonexpansive finite set of map**s and nonexpansive semigroups are given. They extend some existing theorems. △ Less

Submitted 18 September, 2009; originally announced September 2009.

Iterative schemes for computing fixed points of nonexpansive map**s in Banach spaces

Authors: Jean-Philippe Chancelier

Abstract: Let $X$ be a real Banach space with a normalized duality map** uniformly norm-to-weak$^\star$ continuous on bounded sets or a reflexive Banach space which admits a weakly continuous duality map** $J_Φ$ with gauge $φ$. Let $f$ be an {\em $α$-contraction} and $\{T_n\}$ a sequence of nonexpansive map**, we study the strong convergence of explicit iterative schemes x_{n+1} = α_n f(x_n) + (1-… ▽ More Let $X$ be a real Banach space with a normalized duality map** uniformly norm-to-weak$^\star$ continuous on bounded sets or a reflexive Banach space which admits a weakly continuous duality map** $J_Φ$ with gauge $φ$. Let $f$ be an {\em $α$-contraction} and $\{T_n\}$ a sequence of nonexpansive map**, we study the strong convergence of explicit iterative schemes x_{n+1} = α_n f(x_n) + (1-α_n) T_n x_n with a general theorem and then recover and improve some specific cases studied in the literature △ Less

Submitted 7 December, 2007; originally announced December 2007.

${\cal T}$-class algorithms for pseudocontractions and $κ$-strict pseudocontractions in Hilbert spaces

Authors: Jean-Philippe Chancelier

Abstract: In this paper we study iterative algorithms for finding a common element of the set of fixed points of $κ$-strict pseudocontractions or finding a solution of a variational inequality problem for a monotone, Lipschitz continuous map**. The last problem being related to finding fixed points of pseudocontractions. These algorithms were already studied in [G.L. Acedo, H.-K. Xu] and [N. Nadezhkina,… ▽ More In this paper we study iterative algorithms for finding a common element of the set of fixed points of $κ$-strict pseudocontractions or finding a solution of a variational inequality problem for a monotone, Lipschitz continuous map**. The last problem being related to finding fixed points of pseudocontractions. These algorithms were already studied in [G.L. Acedo, H.-K. Xu] and [N. Nadezhkina, W. Takahashi] but our aim here is to provide the links between these know algorithms and the general framework of ${\cal T}$-class algorithms studied in [H.H. Bauschke, P.L. Combettes]. △ Less

Submitted 4 December, 2007; originally announced December 2007.