-
Multistage stochastic optimization of a mono-site hydrogen infrastructure by decomposition techniques
Authors:
Raian Lefgoum,
Sezin Afsar,
Pierre Carpentier,
Jean-Philippe Chancelier,
Michel de Lara
Abstract:
The development of hydrogen infrastructures requires to reduce their costs. In this paper, we develop a multistage stochastic optimization model for the management of a hydrogen infrastructure which consists of an electrolyser, a compressor and a storage to serve a transportation demand. This infrastructure is powered by three different sources: on-site photovoltaic panels (PV), renewable ene…
▽ More
The development of hydrogen infrastructures requires to reduce their costs. In this paper, we develop a multistage stochastic optimization model for the management of a hydrogen infrastructure which consists of an electrolyser, a compressor and a storage to serve a transportation demand. This infrastructure is powered by three different sources: on-site photovoltaic panels (PV), renewable energy through a power purchase agreement (PPA) and the power grid. We consider uncertainties affecting on-site photovoltaic production and hydrogen demand. Renewable energy sources are emphasized in the hydrogen production process to ensure eligibility for a subsidy, which is awarded if the proportion of nonrenewable electricity usage stays under a predetermined threshold. We solve the multistage stochastic optimization problem using a decomposition method based on Lagrange duality. The numerical results indicate that the solution to this problem, formulated as a policy, achieves a small duality gap, thus proving the effectiveness of this approach.
△ Less
Submitted 1 July, 2024;
originally announced July 2024.
-
Construction of continuous collective energy landscapes for large amplitude nuclear many-body problems
Authors:
Paul Carpentier,
Nathalie Pillet,
Denis Lacroix,
Noel Dubray,
David Regnier
Abstract:
Several protocols are proposed to build continuous energy surfaces of many-body quantum systems, regarding both energy and states. The standard variational principle is augmented with constraints on state overlap, ensuring arbitrary precision on continuity. As an illustration, the lowest energy and excited state paths relevant for the $^{240}$Pu asymmetric fission are studied. The scission is clea…
▽ More
Several protocols are proposed to build continuous energy surfaces of many-body quantum systems, regarding both energy and states. The standard variational principle is augmented with constraints on state overlap, ensuring arbitrary precision on continuity. As an illustration, the lowest energy and excited state paths relevant for the $^{240}$Pu asymmetric fission are studied. The scission is clearly signed, with a neutron excess in the neck, the ultimate glue before its rupture. Our approach can potentially connect any couple of Hilbert space states, which opens up new horizons for various applications.
△ Less
Submitted 28 May, 2024;
originally announced May 2024.
-
Decomposition Methods for Dynamically Monotone Two-Time-Scale Stochastic Optimization Problems
Authors:
Tristan Rigaut,
Pierre Carpentier,
Jean-Philippe Chancelier,
Michel de Lara
Abstract:
In energy management, it is common that strategic investment decisions (storage capacity, production units) are made at a slow time scale, whereas operational decisions (storage, production) are made at a fast time scale: for such problems, the total number of decision stages may be huge. In this paper, we consider multistage stochastic optimization problems with two time-scales, and we propose a…
▽ More
In energy management, it is common that strategic investment decisions (storage capacity, production units) are made at a slow time scale, whereas operational decisions (storage, production) are made at a fast time scale: for such problems, the total number of decision stages may be huge. In this paper, we consider multistage stochastic optimization problems with two time-scales, and we propose a time block decomposition scheme to address them numerically. More precisely, our approach relies on two assumptions. On the one hand, we suppose slow time scale stagewise independence of the noise process: the random variables that occur during a slow time scale interval are independent of those at another slow time scale interval. This makes it possible to use Dynamic Programming at the slow time scale. On the other hand, we suppose a dynamically monotone property for the problem under consideration, which makes it possible to obtain bounds. Then, we present two algorithmic methods to compute upper and lower bounds for slow time scale Bellman value functions. Both methods rely respectively on primal and dual decomposition of the Bellman equation applied at the slow time scale. We assess the methods tractability and validate their efficiency by solving a battery management problem where the fast time scale operational decisions have an impact on the storage current capacity, hence on the strategic decisions to renew the battery at the slow time scale.
△ Less
Submitted 7 March, 2023;
originally announced March 2023.
-
Contributions on complexity bounds for Deterministic Partially Observed Markov Decision Process
Authors:
Cyrille Vessaire,
Jean-Philippe Chancelier,
Michel de Lara,
Pierre Carpentier,
Alejandro Rodríguez-Martínez
Abstract:
Markov Decision Processes (Mdps) form a versatile framework used to model a wide range of optimization problems. The Mdp model consists of sets of states, actions, time steps, rewards, and probability transitions. When in a given state and at a given time, the decision maker's action generates a reward and determines the state at the next time step according to the probability transition function.…
▽ More
Markov Decision Processes (Mdps) form a versatile framework used to model a wide range of optimization problems. The Mdp model consists of sets of states, actions, time steps, rewards, and probability transitions. When in a given state and at a given time, the decision maker's action generates a reward and determines the state at the next time step according to the probability transition function. However, Mdps assume that the decision maker knows the state of the controlled dynamical system. Hence, when one needs to optimize controlled dynamical systems under partial observation, one often turns toward the formalism of Partially Observed Markov Decision Processes (Pomdp). Pomdps are often untractable in the general case as Dynamic Programming suffers from the curse of dimensionality. Instead of focusing on the general Pomdps, we present a subclass where transitions and observations map**s are deterministic: Deterministic Partially Observed Markov Decision Processes (Det-Pomdp). That subclass of problems has been studied by (Littman, 1996) and (Bonet, 2009). It was first considered as a limit case of Pomdps by Littman, mainly used to illustrate the complexity of Pomdps when considering as few sources of uncertainties as possible. In this paper, we improve on Littman's complexity bounds. We then introduce and study an even simpler class: Separated Det-Pomdps and give some new complexity bounds for this class. This new class of problems uses a property of the dynamics and observation to push back the curse of dimensionality.
△ Less
Submitted 20 January, 2023;
originally announced January 2023.
-
Differentiability and Regularization of Parametric Convex Value Functions in Stochastic Multistage Optimization
Authors:
Adrien Le Franc,
Jean-Philippe Chancelier,
Pierre Carpentier,
Michel de Lara
Abstract:
In multistage decision problems, it is often the case that an initial strategic decision (such as investment) is followed by many operational ones (operating the investment). Such initial strategic decision can be seen as a parameter affecting a multistage decision problem. More generally, we study in this paper a standard multistage stochastic optimization problem depending on a parameter. When t…
▽ More
In multistage decision problems, it is often the case that an initial strategic decision (such as investment) is followed by many operational ones (operating the investment). Such initial strategic decision can be seen as a parameter affecting a multistage decision problem. More generally, we study in this paper a standard multistage stochastic optimization problem depending on a parameter. When the parameter is fixed, Stochastic Dynamic Programming provides a way to compute the optimal value of the problem. Thus, the value function depends both on the state (as usual) and on the parameter. Our aim is to investigate on the possibility to efficiently compute gradients of the value function with respect to the parameter, when these objects exist. When nondifferentiable, we propose a regularization method based on the Moreau-Yosida envelope. We present a numerical test case from day-ahead power scheduling.
△ Less
Submitted 6 February, 2023; v1 submitted 20 December, 2022;
originally announced December 2022.
-
Time Consistency for Multistage Stochastic Optimization Problems under Constraints in Expectation
Authors:
Pierre Carpentier,
Jean-Philippe Chancelier,
Michel de Lara
Abstract:
We consider sequences-indexed by time (discrete stages)-of families of multistage stochastic optimization problems. At each time, the optimization problems in a family are parameterized by some quantities (initial states, constraint levels.. .). In this framework, we introduce an adapted notion of time consistent optimal solutions, that is, solutions that remain optimal after truncation of the pas…
▽ More
We consider sequences-indexed by time (discrete stages)-of families of multistage stochastic optimization problems. At each time, the optimization problems in a family are parameterized by some quantities (initial states, constraint levels.. .). In this framework, we introduce an adapted notion of time consistent optimal solutions, that is, solutions that remain optimal after truncation of the past and that are optimal for any values of the parameters. We link this time consistency notion with the concept of state variable in Markov Decision Processes for a class of multistage stochastic optimization problems incorporating state constraints at the final time, either formulated in expectation or in probability. For such problems, when the primitive noise random process is stagewise independent and takes a finite number of values, we show that time consistent solutions can be obtained by considering a finite dimensional state variable. We illustrate our results on a simple dam management problem.
△ Less
Submitted 29 August, 2022;
originally announced August 2022.
-
Optimization of a domestic microgrid equipped with solar panel and battery: Model Predictive Control and Stochastic Dual Dynamic Programming approaches
Authors:
François Pacaud,
Pierre Carpentier,
Jean-Philippe Chancelier,
Michel de Lara
Abstract:
In this study, a microgrid with storage (battery, hot water tank) and solar panel is considered. We benchmark two algorithms, MPC and SDDP, that yield online policies to manage the microgrid, and compare them with a rule based policy. Model Predictive Control (MPC) is a well-known algorithm which models the future uncertainties with a deterministic forecast. By contrast, Stochastic Dual Dynamic Pr…
▽ More
In this study, a microgrid with storage (battery, hot water tank) and solar panel is considered. We benchmark two algorithms, MPC and SDDP, that yield online policies to manage the microgrid, and compare them with a rule based policy. Model Predictive Control (MPC) is a well-known algorithm which models the future uncertainties with a deterministic forecast. By contrast, Stochastic Dual Dynamic Programming (SDDP) models the future uncertainties as stagewise independent random variables with known probability distributions. We present a scheme, based on out-of-sample validation, to fairly compare the two online policies yielded by MPC and SDDP. Our numerical studies put to light that MPC and SDDP achieve significant gains compared to the rule based policy, and that SDDP overperforms MPC not only on average but on most of the out-of-sample assessment scenarios.
△ Less
Submitted 16 May, 2022;
originally announced May 2022.
-
Multistage Optimization of a Petroleum Production System with Material Balance Model
Authors:
Cyrille Vessaire,
Jean-Philippe Chancelier,
Michel de Lara,
Pierre Carpentier,
Alejandro Rodríguez-Martínez,
Anna Roberts
Abstract:
In this paper, we propose a mathematical formulation for the management of an oil production network as a multistage optimization problem. The reservoir is modeled as a controlled dynamical system by using material balance equations. We use a dynamic programming algorithm to solve the optimization problem. Two numerical applications illustrate our work: the first one consists in optimizing the pro…
▽ More
In this paper, we propose a mathematical formulation for the management of an oil production network as a multistage optimization problem. The reservoir is modeled as a controlled dynamical system by using material balance equations. We use a dynamic programming algorithm to solve the optimization problem. Two numerical applications illustrate our work: the first one consists in optimizing the production of a gas reservoir, whereas the second one tackles an oil reservoir with water injection.
△ Less
Submitted 20 September, 2022; v1 submitted 4 January, 2022;
originally announced January 2022.
-
Decentralized Multistage Optimization of Large-Scale Microgrids under Stochasticity
Authors:
François Pacaud,
Michel de Lara,
Jean-Philippe Chancelier,
Pierre Carpentier
Abstract:
Microgrids are recognized as a relevant tool to absorb decentralized renewable energies in the energy mix. However, the sequential handling of multiple stochastic productions and demands, and of storage, make their management a delicate issue. We add another layer of complexity by considering microgrids where different buildings stand at the nodes of a network and are connected by the arcs; some b…
▽ More
Microgrids are recognized as a relevant tool to absorb decentralized renewable energies in the energy mix. However, the sequential handling of multiple stochastic productions and demands, and of storage, make their management a delicate issue. We add another layer of complexity by considering microgrids where different buildings stand at the nodes of a network and are connected by the arcs; some buildings host local production and storage capabilities, and can exchange with others their energy surplus. We formulate the problem as a multistage stochastic optimization problem, corresponding to the minimization of the expected temporal sum of operational costs, while satisfying the energy demand at each node, for all time. The resulting mathematical problem has a large-scale nature, exhibiting both spatial and temporal couplings. However, the problem displays a network structure that makes it amenable to a mix of spatial decomposition-coordination with temporal decomposition methods. We conduct numerical simulations on microgrids of different sizes and topologies, with up to 48 nodes and 64 state variables. Decomposition methods are faster and provide more efficient policies than a state-of-the-art Stochastic Dual Dynamic Programming algorithm. Moreover, they scale almost linearly with the state dimension, making them a promising tool to address more complex microgrid optimal management problems.
△ Less
Submitted 8 June, 2021;
originally announced June 2021.
-
The stochastic Auxiliary Problem Principle in Banach spaces: measurability and convergence
Authors:
Thomas Bittar,
Pierre Carpentier,
Jean-Philippe Chancelier,
Jérôme Lonchampt
Abstract:
The stochastic Auxiliary Problem Principle (APP) algorithm is a general Stochastic Approximation (SA) scheme that turns the resolution of an original optimization problem into the iterative resolution of a sequence of auxiliary problems. This framework has been introduced to design decomposition-coordination schemes but also encompasses many well-known SA algorithms such as stochastic gradient des…
▽ More
The stochastic Auxiliary Problem Principle (APP) algorithm is a general Stochastic Approximation (SA) scheme that turns the resolution of an original optimization problem into the iterative resolution of a sequence of auxiliary problems. This framework has been introduced to design decomposition-coordination schemes but also encompasses many well-known SA algorithms such as stochastic gradient descent or stochastic mirror descent. We study the stochastic APP in the case where the iterates lie in a Banach space and we consider an additive error on the computation of the subgradient of the objective. In order to derive convergence results or efficiency estimates for a SA scheme, the iterates must be random variables. This is why we prove the measurability of the iterates of the stochastic APP algorithm. Then, we extend convergence results from the Hilbert space case to the Banach space case. Finally, we derive efficiency estimates for the function values taken at the averaged sequence of iterates or at the last iterate, the latter being obtained by adapting the concept of modified Fej{é}r monotonicity to our framework.
△ Less
Submitted 20 May, 2022; v1 submitted 20 January, 2021;
originally announced January 2021.
-
A Decomposition Method by Interaction Prediction for the Optimization of Maintenance Scheduling
Authors:
Jean-Philippe Chancelier,
Thomas Bittar,
Pierre Carpentier,
J-Ph Chancelier,
Jérôme Lonchampt
Abstract:
Optimizing maintenance scheduling is a major issue to improve the performance of hydropower plants. We study a system of several physical components of the same family: either a set of turbines, a set of transformers or a set of generators. The components share a common stock of spare parts and experience random failures that occur according to known failure distributions. We seek a deterministic…
▽ More
Optimizing maintenance scheduling is a major issue to improve the performance of hydropower plants. We study a system of several physical components of the same family: either a set of turbines, a set of transformers or a set of generators. The components share a common stock of spare parts and experience random failures that occur according to known failure distributions. We seek a deterministic preventive maintenance strategy that minimizes an expected cost depending on maintenance and forced outages of the system. The Auxiliary Problem Principle is used to decompose the original large-scale optimization problem into a sequence of independent subproblems of smaller dimension while ensuring their coordination. Each subproblem consists in optimizing the maintenance on a single component. Decomposition-coordination techniques are based on variational techniques but the maintenance optimization problem is a mixed-integer problem. Therefore, we relax the dynamics and the cost functions of the system. The resulting algorithm iteratively solves the subproblems on the relaxed system with a blackbox method and coordinates the components. Relaxation parameters have an important influence on the optimization and must be appropriately chosen. An admissible maintenance strategy is then derived from the resolution of the relaxed problem. We apply the decomposition algorithm on a system with 80 components. It outperforms the reference blackbox method applied directly on the original problem.
△ Less
Submitted 6 May, 2021; v1 submitted 25 February, 2020;
originally announced February 2020.
-
EMSx: a numerical benchmark for energy management systems
Authors:
Adrien Le Franc,
Pierre Carpentier,
Jean-Philippe Chancelier,
Michel de Lara
Abstract:
Inserting renewable energy in the electric grid in a decentralized manneris a key challenge of the energy transition. However, at local scale, both production and demand display erratic behavior, which makes it delicate to match them. It is the goal of Energy Management Systems (EMS) to achieve such balance at least cost. We present EMSx, a numerical benchmark for testing control algorithms for th…
▽ More
Inserting renewable energy in the electric grid in a decentralized manneris a key challenge of the energy transition. However, at local scale, both production and demand display erratic behavior, which makes it delicate to match them. It is the goal of Energy Management Systems (EMS) to achieve such balance at least cost. We present EMSx, a numerical benchmark for testing control algorithms for the management of electric microgrids equipped with a photovoltaic unit and an energy storage system. EMSx is made of three key components: the EMSx dataset, provided by Schneider Electric, contains a diverse pool of realistic microgrids with a rich collection of historical observations and forecasts; the EMSx mathematical framework is an explicit description of the assessment of electric microgrid control techniques and algorithms; the EMSx software EMSx.jl is a package, implemented in the Julia language, which enables to easily implement a microgrid controller and to test it. All components of the benchmark are publicly available, so that other researchers willing to test controllers on EMSx may reproduce experiments easily. Eventually, we showcase the results of standard microgrid control methods, including Model Predictive Control, Open Loop Feedback Control and Stochastic Dynamic Programming.
△ Less
Submitted 14 October, 2021; v1 submitted 2 January, 2020;
originally announced January 2020.
-
Upper and Lower Bounds for Large Scale Multistage Stochastic Optimization Problems: Application to Microgrid Management
Authors:
Pierre Carpentier,
Jean-Philippe Chancelier,
Michel de Lara,
François Pacaud
Abstract:
We consider a microgrid where different prosumers exchange energy altogether by the edges of a given network. Each prosumer is located to a node of the network and encompasses energy consumption, energy production and storage capacities (battery, electrical hot water tank). The problem is coupled both in time and in space, so that a direct resolution of the problem for large microgrids is out of r…
▽ More
We consider a microgrid where different prosumers exchange energy altogether by the edges of a given network. Each prosumer is located to a node of the network and encompasses energy consumption, energy production and storage capacities (battery, electrical hot water tank). The problem is coupled both in time and in space, so that a direct resolution of the problem for large microgrids is out of reach (curse of dimensionality). By affecting price or resources to each node in the network and resolving each nodal sub-problem independently by Dynamic Programming, we provide decomposition algorithms that allow to compute a set of decomposed local value functions in a parallel manner. By summing the local value functions together, we are able, on the one hand, to obtain upper and lower bounds for the optimal value of the problem, and, on the other hand, to design global admissible policies for the original system. Numerical experiments are conducted on microgrids of different size, derived from data given by the research and development centre Efficacity, dedicated to urban energy transition. These experiments show that the decomposition algorithms give better results than the standard SDDP method, both in terms of bounds and policy values. Moreover, the decomposition methods are much faster than the SDDP method in terms of computation time, thus allowing to tackle problem instances incorporating more than 60 state variables in a Dynamic Programming framework.
△ Less
Submitted 23 December, 2019;
originally announced December 2019.
-
Mixed Spatial and Temporal Decompositions for Large Scale Multistage Stochastic Optimization Problems
Authors:
Pierre Carpentier,
Jean-Philippe Chancelier,
Michel de Lara,
François Pacaud
Abstract:
We consider multistage stochastic optimization problems involving multiple units. Each unit is a (small) control system. Static constraints couple units at each stage. We present a mix of spatial and temporal decompositions to tackle such large scale problems. More precisely, we obtain theoretical bounds and policies by means of two methods, depending whether the coupling constraints are handled b…
▽ More
We consider multistage stochastic optimization problems involving multiple units. Each unit is a (small) control system. Static constraints couple units at each stage. We present a mix of spatial and temporal decompositions to tackle such large scale problems. More precisely, we obtain theoretical bounds and policies by means of two methods, depending whether the coupling constraints are handled by prices or by resources. We study both centralized and decentralized information structures. We report the results of numerical experiments on the management of urban microgrids. It appears that decomposition methods are much faster and give better results than the standard Stochastic Dual Dynamic Programming method, both in terms of bounds and of policy performance.
△ Less
Submitted 17 June, 2021; v1 submitted 23 December, 2019;
originally announced December 2019.
-
Some properties of Bowlin and Brin's color graphs
Authors:
Rui Pedro Carpentier,
Roger Picken
Abstract:
Bowlin and Brin defined the class of color graphs, whose vertices are triangulated polygons compatible with a fixed four-coloring of the polygon vertices. In this article it is proven that each color graph has a vertex-induced embedding in a hypercube, and an upper bound is given for the hypercube dimension. The color graphs for $n$-gons up to $n=8$ are listed and some of their features are discus…
▽ More
Bowlin and Brin defined the class of color graphs, whose vertices are triangulated polygons compatible with a fixed four-coloring of the polygon vertices. In this article it is proven that each color graph has a vertex-induced embedding in a hypercube, and an upper bound is given for the hypercube dimension. The color graphs for $n$-gons up to $n=8$ are listed and some of their features are discussed. Finally it is shown that certain color graphs cannot be isometrically embedded in a hypercube of any dimension.
△ Less
Submitted 2 July, 2018; v1 submitted 23 April, 2018;
originally announced April 2018.
-
Time Blocks Decomposition of Multistage Stochastic Optimization Problems
Authors:
Pierre Carpentier,
Jean-Philippe Chancelier,
Michel de Lara,
Thomas Martin,
Tristan Rigaut
Abstract:
Multistage stochastic optimization problems are, by essence, complex as their solutions are indexed both by stages and by uncertainties. Their large scale nature makes decomposition methods appealing, like dynamic programming which is a sequential decomposition using a state variable defined at all stages. In this paper, we introduce the notion of state reduction by time blocks, that is, at…
▽ More
Multistage stochastic optimization problems are, by essence, complex as their solutions are indexed both by stages and by uncertainties. Their large scale nature makes decomposition methods appealing, like dynamic programming which is a sequential decomposition using a state variable defined at all stages. In this paper, we introduce the notion of state reduction by time blocks, that is, at stages that are not necessarily all the original stages. Then, we prove a reduced dynamic programming equation. We position our result with respect to the most well-known mathematical frameworks for dynamic programming. We illustrate our contribution by showing its potential for applied problems with two time scales.
△ Less
Submitted 28 April, 2023; v1 submitted 5 April, 2018;
originally announced April 2018.
-
Stochastic optimal control of a domestic microgrid equipped with solar panel and battery
Authors:
François Pacaud,
Pierre Carpentier,
Jean-Philippe Chancelier,
Michel De Lara
Abstract:
Microgrids are integrated systems that gather and operate energy production units to satisfy consumers demands. This paper details different mathematical methods to design the Energy Management System (EMS) of domestic microgrids. We consider different stocks coupled together - a battery, a domestic hot water tank - and decentralized energy production with solar panel. The main challenge of the EM…
▽ More
Microgrids are integrated systems that gather and operate energy production units to satisfy consumers demands. This paper details different mathematical methods to design the Energy Management System (EMS) of domestic microgrids. We consider different stocks coupled together - a battery, a domestic hot water tank - and decentralized energy production with solar panel. The main challenge of the EMS is to ensure, at least cost, that supply matches demand for all time, while considering the inherent uncertainties of such systems. We benchmark two optimization algorithms to manage the EMS, and compare them with a heuristic. The Model Predictive Control (MPC) is a well known algorithm which models the future uncertainties with a deterministic forecast. By contrast, Stochastic Dual Dynamic Programming (SDDP) models the future uncertainties as probability distributions to compute optimal policies. We present a fair comparison of these two algorithms to control microgrid. A comprehensive numerical study shows that i) optimization algorithms achieve significant gains compared to the heuristic, ii) SDDP outperforms MPC by a few percents, with a reasonable computational overhead.
△ Less
Submitted 19 January, 2018;
originally announced January 2018.
-
Stochastic Optimization of Braking Energy Storage and Ventilation in a Subway Station
Authors:
Tristan Rigaut,
Pierre Carpentier,
Jean Philippe Chancelier,
Michel De Lara,
Julien Waeytens
Abstract:
In the Paris subway system, stations represent about one third of the overall energy consumption. Within stations, ventilation is among the top consuming devices; it is operated at maximum airflow all day long, for air quality reasons. In this paper, we present a concept of energy system that displays comparable air quality while consuming much less energy. The system comprises a battery that make…
▽ More
In the Paris subway system, stations represent about one third of the overall energy consumption. Within stations, ventilation is among the top consuming devices; it is operated at maximum airflow all day long, for air quality reasons. In this paper, we present a concept of energy system that displays comparable air quality while consuming much less energy. The system comprises a battery that makes it possible to recover the trains braking energy, arriving under the form of erratic and strong peaks. We propose an energy management system (EMS) that, at short time scale, controls energy flows and ventilation airflow. By using proper optimization algorithms, we manage to match supply with demand, while minimizing energy daily costs. For this purpose, we have designed algorithms that take into account the braking variability. They are based on the so-called Stochastic Dynamic Programming (SDP) mathematical framework. We fairly compare SDP based algorithms with the widespread Model Predictive Control (MPC) ones. First, both SDP and MPC yield energy/money operating savings of the order of one third, compared to the current management without battery (our figure does not include the cost of the battery). Second, depending on the specific design, we observe that SDP outperforms MPC by a few percent, with an easier online numerical implementation.
△ Less
Submitted 22 February, 2018; v1 submitted 9 January, 2018;
originally announced January 2018.
-
Stochastic decomposition applied to large-scale hydro valleys management
Authors:
François Pacaud,
Pierre Carpentier,
Jean-Philippe Chancelier,
Vincent Leclère
Abstract:
We are interested in optimally controlling a discrete time dynamical system that can be influenced by exogenous uncertainties. This is generally called a Stochas-tic Optimal Control (SOC) problem and the Dynamic Programming (DP) principle is one of the standard way of solving it. Unfortunately, DP faces the so-called curse of dimensionality: the complexity of solving DP equations grows exponential…
▽ More
We are interested in optimally controlling a discrete time dynamical system that can be influenced by exogenous uncertainties. This is generally called a Stochas-tic Optimal Control (SOC) problem and the Dynamic Programming (DP) principle is one of the standard way of solving it. Unfortunately, DP faces the so-called curse of dimensionality: the complexity of solving DP equations grows exponentially with the dimension of the variable that is sufficient to take optimal decisions (the so-called state variable). For a large class of SOC problems, which includes important practical applications in energy management, we propose an original way of obtaining near optimal controls. The algorithm we introduce is based on Lagrangian relaxation, of which the application to decomposition is well-known in the deterministic framework. However, its application to such closed-loop problems is not straightforward and an additional statistical approximation concerning the dual process is needed. The resulting methodology is called Dual Approximate Dynamic Programming (DADP). We briefly present DADP, give interpretations and enlighten the error induced by the approximation. The paper is mainly devoted to applying DADP to the management of large hydro valleys. The modeling of such systems is presented, as well as the practical implementation of the methodology. Numerical results are provided on several valleys, and we compare our approach with the state of the art SDDP method.
△ Less
Submitted 24 May, 2017;
originally announced May 2017.
-
Raman-assisted crystallography reveals end-on peroxide intermediates in a nonheme iron enzyme
Authors:
Gergely Katona,
Philippe Carpentier,
Vincent Nivière,
Patricia Amara,
Virgile Adam,
Jérémy Ohana,
Nikolay Tsanov,
Dominique Bourgeois
Abstract:
Iron-peroxide intermediates are central in the reaction cycle of many iron-containing biomolecules. We trapped iron(III)-(hydro)peroxo species in crystals of superoxide reductase (SOR), a nonheme mononuclear iron enzyme that scavenges superoxide radicals. X-ray diffraction data at 1.95 angstrom resolution and Raman spectra recorded in crystallo revealed iron-(hydro)peroxo intermediates with the (h…
▽ More
Iron-peroxide intermediates are central in the reaction cycle of many iron-containing biomolecules. We trapped iron(III)-(hydro)peroxo species in crystals of superoxide reductase (SOR), a nonheme mononuclear iron enzyme that scavenges superoxide radicals. X-ray diffraction data at 1.95 angstrom resolution and Raman spectra recorded in crystallo revealed iron-(hydro)peroxo intermediates with the (hydro)peroxo group bound end-on. The dynamic SOR active site promotes the formation of transient hydrogen bond networks, which presumably assist the cleavage of the iron-oxygen bond in order to release the reaction product, hydrogen peroxide.
△ Less
Submitted 16 December, 2014;
originally announced December 2014.
-
Extending triangulations of the 2-sphere to the 3-disk preserving a 4-coloring
Authors:
Rui Pedro Carpentier
Abstract:
In this paper we prove that any triangulation of a 2-dimensional sphere with a strict 4-coloring on its vertices can seen as the boundary of a triangulation of a 3-dimensional disk with the same vertices and preserving the 4-coloring.
In this paper we prove that any triangulation of a 2-dimensional sphere with a strict 4-coloring on its vertices can seen as the boundary of a triangulation of a 3-dimensional disk with the same vertices and preserving the 4-coloring.
△ Less
Submitted 3 February, 2011; v1 submitted 28 January, 2011;
originally announced January 2011.
-
Price decomposition in large-scale stochastic optimal control
Authors:
Kengy Barty,
Pierre Carpentier,
Guy Cohen,
Pierre Girardeau
Abstract:
We are interested in optimally driving a dynamical system that can be influenced by exogenous noises. This is generally called a Stochastic Optimal Control (SOC) problem and the Dynamic Programming (DP) principle is the natural way of solving it. Unfortunately, DP faces the so-called curse of dimensionality: the complexity of solving DP equations grows exponentially with the dimension of the infor…
▽ More
We are interested in optimally driving a dynamical system that can be influenced by exogenous noises. This is generally called a Stochastic Optimal Control (SOC) problem and the Dynamic Programming (DP) principle is the natural way of solving it. Unfortunately, DP faces the so-called curse of dimensionality: the complexity of solving DP equations grows exponentially with the dimension of the information variable that is sufficient to take optimal decisions (the state variable). For a large class of SOC problems, which includes important practical problems, we propose an original way of obtaining strategies to drive the system. The algorithm we introduce is based on Lagrangian relaxation, of which the application to decomposition is well-known in the deterministic framework. However, its application to such closed-loop problems is not straightforward and an additional statistical approximation concerning the dual process is needed. We give a convergence proof, that derives directly from classical results concerning duality in optimization, and enlghten the error made by our approximation. Numerical results are also provided, on a large-scale SOC problem. This idea extends the original DADP algorithm that was presented by Barty, Carpentier and Girardeau (2010).
△ Less
Submitted 15 December, 2010; v1 submitted 9 December, 2010;
originally announced December 2010.
-
Three-Colorings of Cubic Graphs and Tensor Operators
Authors:
Rui Pedro Carpentier
Abstract:
Penrose's work \cite{8} established a connection between the edge 3-colorings of cubic planar graphs and tensor algebras. We exploit this point of view in order to get algebraic representations of the category of cubic graphs with free ends.
Penrose's work \cite{8} established a connection between the edge 3-colorings of cubic planar graphs and tensor algebras. We exploit this point of view in order to get algebraic representations of the category of cubic graphs with free ends.
△ Less
Submitted 29 September, 2010; v1 submitted 13 September, 2010;
originally announced September 2010.
-
Dynamic consistency for Stochastic Optimal Control problems
Authors:
Pierre Carpentier,
Jean-Philippe Chancelier,
Guy Cohen,
Michel De Lara,
Pierre Girardeau
Abstract:
For a sequence of dynamic optimization problems, we aim at discussing a notion of consistency over time. This notion can be informally introduced as follows. At the very first time step $t_0$, the decision maker formulates an optimization problem that yields optimal decision rules for all the forthcoming time step $t_0, t_1, ..., T$; at the next time step $t_1$, he is able to formulate a new optim…
▽ More
For a sequence of dynamic optimization problems, we aim at discussing a notion of consistency over time. This notion can be informally introduced as follows. At the very first time step $t_0$, the decision maker formulates an optimization problem that yields optimal decision rules for all the forthcoming time step $t_0, t_1, ..., T$; at the next time step $t_1$, he is able to formulate a new optimization problem starting at time $t_1$ that yields a new sequence of optimal decision rules. This process can be continued until final time $T$ is reached. A family of optimization problems formulated in this way is said to be time consistent if the optimal strategies obtained when solving the original problem remain optimal for all subsequent problems. The notion of time consistency, well-known in the field of Economics, has been recently introduced in the context of risk measures, notably by Artzner et al. (2007) and studied in the Stochastic Programming framework by Shapiro (2009) and for Markov Decision Processes (MDP) by Ruszczynski (2009). We here link this notion with the concept of "state variable" in MDP, and show that a significant class of dynamic optimization problems are dynamically consistent, provided that an adequate state variable is chosen.
△ Less
Submitted 20 May, 2010;
originally announced May 2010.
-
Particle Methods For Stochastic Optimal Control Problems
Authors:
Pierre Carpentier,
Guy Cohen,
Anes Dallagi
Abstract:
To tackle the difficulties faced by both stochastic dynamic programming and scenario tree methods, we present some variational approach for numerical solution of stochastic optimal control problems. We consider two different interpretations of the control problem, an algebraic and a functional one from which we derive optimality conditions. An adaptative mesh discretization method will be used t…
▽ More
To tackle the difficulties faced by both stochastic dynamic programming and scenario tree methods, we present some variational approach for numerical solution of stochastic optimal control problems. We consider two different interpretations of the control problem, an algebraic and a functional one from which we derive optimality conditions. An adaptative mesh discretization method will be used to propose a tractable solution algorithm. An application to a hydro-electric dam production management problem will be presented.
△ Less
Submitted 27 July, 2009;
originally announced July 2009.
-
On signed diagonal flip sequences
Authors:
Rui Pedro Carpentier
Abstract:
Eliahou \cite{2} and Kryuchkov \cite{9} conjectured a proposition that Gravier and Payan \cite{4} proved to be equivalent to the Four Color Theorem. It states that any triangulation of a polygon can be transformed into another triangulation of the same polygon by a sequence of signed diagonal flips. It is well known that any pair of polygonal triangulations are connected by a sequence of (non-sign…
▽ More
Eliahou \cite{2} and Kryuchkov \cite{9} conjectured a proposition that Gravier and Payan \cite{4} proved to be equivalent to the Four Color Theorem. It states that any triangulation of a polygon can be transformed into another triangulation of the same polygon by a sequence of signed diagonal flips. It is well known that any pair of polygonal triangulations are connected by a sequence of (non-signed) diagonal flips. In this paper we give a sufficient and necessary condition for a diagonal flip sequence to be a signed diagonal flip sequence.
△ Less
Submitted 4 February, 2011; v1 submitted 29 June, 2009;
originally announced June 2009.
-
Decomposition of large-scale stochastic optimal control problems
Authors:
Kengy Barty,
Pierre Carpentier,
Pierre Girardeau
Abstract:
In this paper, we present an Uzawa-based heuristic that is adapted to some type of stochastic optimal control problems. More precisely, we consider dynamical systems that can be divided into small-scale independent subsystems, though linked through a static almost sure coupling constraint at each time step. This type of problem is common in production/portfolio management where subsystems are, f…
▽ More
In this paper, we present an Uzawa-based heuristic that is adapted to some type of stochastic optimal control problems. More precisely, we consider dynamical systems that can be divided into small-scale independent subsystems, though linked through a static almost sure coupling constraint at each time step. This type of problem is common in production/portfolio management where subsystems are, for instance, power units, and one has to supply a stochastic power demand at each time step. We outline the framework of our approach and present promising numerical results on a simplified power management problem.
△ Less
Submitted 6 March, 2009;
originally announced March 2009.
-
Representations of non-singular planar tangles by operators
Authors:
Rui Pedro Carpentier
Abstract:
In this paper we study how to distinguish two embeddings of a finite collection of disjoint circles into the plane up to planar isotopy. We adopt the spirit of the approach by V. Turaev, Operator Invariants of Tangles, Math. USSR-Izv. 35 (1990), 411--444, by considering a category of planar tangles and representing it in an ``algebraic'' category. From this we can extract a numerical invariant f…
▽ More
In this paper we study how to distinguish two embeddings of a finite collection of disjoint circles into the plane up to planar isotopy. We adopt the spirit of the approach by V. Turaev, Operator Invariants of Tangles, Math. USSR-Izv. 35 (1990), 411--444, by considering a category of planar tangles and representing it in an ``algebraic'' category. From this we can extract a numerical invariant for embeddings of a finite collection of disjoint circles and this invariant is, up to certain choices, complete.
△ Less
Submitted 17 April, 2005;
originally announced April 2005.
-
Topological notions for Kauffman and Vogel's polynomial
Authors:
Rui Pedro Carpentier
Abstract:
In [2] Kauffman and Vogel constructed a rigid vertex regular isotopy invariant for unoriented four-valent graphs embedded in three dimensional space. It assigns to each embedded graph G a polynomial, denoted [G], in three variables, A, B and a, satisfying three skein relations, and is defined in terms of a state-sum and the Dubrovnik polynomial for links.
In previous work by the author it is p…
▽ More
In [2] Kauffman and Vogel constructed a rigid vertex regular isotopy invariant for unoriented four-valent graphs embedded in three dimensional space. It assigns to each embedded graph G a polynomial, denoted [G], in three variables, A, B and a, satisfying three skein relations, and is defined in terms of a state-sum and the Dubrovnik polynomial for links.
In previous work by the author it is proved, in the case B=A^{-1} and a=A, that for a planar graph G we have [G]=2^{c-1}(-A-A^{-1})^v, where c is the number of connected components of G and v is the number of vertices of G.
In this paper we will show how we can calculate the polynomial for embedded graphs, with the variables B=A^{-1} and a=A, without resorting to the skein relation.
△ Less
Submitted 16 April, 2002;
originally announced April 2002.
-
From planar graphs to embedded graphs - a new approach to Kauffman and Vogel's polynomial
Authors:
Rui Pedro Carpentier
Abstract:
In \cite{4} Kauffman and Vogel constructed a rigid vertex regular isotopy invariant for unoriented four-valent graphs embedded in three dimensional space. It assigns to each embedded graph $G$ a polynomial, denoted $[G]$, in three variables, $A$, $B$ and $a$, satisfies the skein relation:…
▽ More
In \cite{4} Kauffman and Vogel constructed a rigid vertex regular isotopy invariant for unoriented four-valent graphs embedded in three dimensional space. It assigns to each embedded graph $G$ a polynomial, denoted $[G]$, in three variables, $A$, $B$ and $a$, satisfies the skein relation: $$ [\psdiag{2}{6}{overcross}]=A [\psdiag{2}{6}{horlines}]+B [\psdiag{2}{6}{verlines}]+[\psdiag{2}{6}{vertex}]$$ and is defined in terms of a state-sum and the Dubrovnik polynomial for links. Using the graphical calculus of \cite{4} it is shown that the polynomial of a planar graph can be calculated recursively from that of planar graphs with less vertices, which also allows the polynomial of an embedded graph to be calculated without resorting to links. The same approach is used to give a direct proof of uniqueness of the (normalized) polynomial restricted to planar graphs. In the case $B=A^{-1}$ and $a=A$, it is proved that for a planar graph $G$ we have $[G]=2^{c-1}(-A-A^{-1})^v $, where $c$ is the number of connected components of $G$ and $v$ is the number of vertices of $G$. As a corollary, a necessary, but not sufficient, condition is obtained for an embedded graph to be ambient isotopic to a planar graph.
△ Less
Submitted 12 May, 2000;
originally announced May 2000.
