arXiv subjects

Pierre Carpentier

Publications and source records attributed to Pierre Carpentier.

At least 19 recordsLinked to original sources

arXiv2025

Temporal and Spatial Decomposition for Prospective Studies in Energy Systems under Uncertainty

The increasing penetration of renewable energy requires greater use of storage resources to manage system intermittency. As a result, there is growing interest in evaluating the opportunity cost of stored energy, or usage values, which can be derived by solving a multistage stochastic optimization problem. Stochasticity arises from net demand (the aggregation of demand and non-dispatchable generation), the availability of dispatchable generation, and inflows when the storage facilities considered are hydroelectric dams. We aim to compute these usage values for each market zone of the interconnected European electricity system, in the context of prospective studies currently conducted by RTE, the French TSO. The energy system is mathematically modelled as a directed graph, where nodes represent market zones and arcs represent interconnection links. In large energy systems, spatial complexity (thirty nodes in the system, each with at most one aggregated storage unit) compounds temporal complexity (a one-year horizon modelled with two timescales: weekly subproblems with hourly time steps). This work addresses three main sources of complexity: temporal, spatial, and stochastic. We tackle the multinode multistage stochastic optimisation problem by incorporating a spatio-temporal decomposition scheme. To efficiently compute usage values, we apply Dual Approximate Dynamic Programming (DADP), which enables tractable decomposition across both time and space. This approach yields nodal usage values that depend solely on the local state of each node, independently of the others. We conduct numerical studies on a realistic system composed of thirty nodes (modelling part of Europe) and show that DADP obtains competitive results when comparing with traditional methods like Stochastic Dual Dynamic Programming (SDDP).

math.OC↗

arXiv2025

Low-thrust Interplanetary Trajectories with Missed Thrust Events: a Numerical Approach

The problem under consideration is to drive a spatial vehicle to a target at a given final time while minimizing fuel consumption. This is a classical optimal control problem in a deterministic setting. However temporary stochastic failures of the engine may prevent reaching the target after the engine usage is recovered. Therefore, a stochastic optimal control problem is formulated under the constraint of ensuring a minimal probability of hitting the target. This problem is modeled, improved and finally solved by dualizing the probability constraint and using an Arrow-Hurwicz stochastic algorithm. Numerical results concerning an interplanetary mission are presented.

math.NA↗

arXiv2025

A Production Routing Problem with Mobile Inventories

Hydrogen is an energy vector, and one possible way to reduce CO 2 emissions. This paper focuses on a hydrogen transport problem where mobile storage units are moved by trucks between sources to be refilled and destinations to meet demands, involving swap operations upon arrival. This contrasts with existing literature where inventories remain stationary. The objective is to optimize daily routing and refilling schedules of the mobile storages. We model the problem as a flow problem on a time-expanded graph, where each node of the graph is indexed by a time-interval and a location and then, we give an equivalent Mixed Integer Linear Programming (MILP) formulation of the problem. For small to medium-sized instances, this formulation can be efficiently solved using standard MILP solvers. However, for larger instances, the computational complexity increases significantly due to the highly combinatorial nature of the refilling process at the sources. To address this challenge, we propose a two-step heuristic that enhances.

math.OC↗

arXiv2024

A Two-Timescale Decision-Hazard-Decision Formulation for Storage Usage Values Calculation

The penetration of renewable energies requires additional storages to deal with intermittency. Accordingly, there is growing interest in evaluating the opportunity cost (usage value) associated with stored energy in large storages, a cost obtained by solving a multistage stochastic optimization problem. Today, to compute usage values under uncertainties, an adequacy resource problem is solved using stochastic dynamic programming assuming a hazard-decision information structure. This modelling assumes complete knowledge of the coming week uncertainties, which is not adapted to the system operation as the intermittency occurs at smaller timescale. We equip the twotimescale problem with a new information structure considering planning and recourse decisions: decision-hazard-decision. This structure is used to decompose the multistage decision-making process into a nonanticipative planning step in which the on/off decisions for the thermal units are made, and a recourse step in which the power modulation decisions are made once the uncertainties have been disclosed. In a numerical case, we illustrate how usage values are sensitive as how the disclosure of information is modelled.

math.OC↗

arXiv2024

Multistage stochastic optimization of a mono-site hydrogen infrastructure by decomposition techniques

The development of hydrogen infrastructures requires to reduce their costs. In this paper, we develop a multistage stochastic optimization model for the management of a hydrogen infrastructure which consists of an electrolyser, a compressor and a storage to serve a transportation demand. This infrastructure is powered by three different sources: on-site photovoltaic panels (PV), renewable energy through a power purchase agreement (PPA) and the power grid. We consider uncertainties affecting on-site photovoltaic production and hydrogen demand. Renewable energy sources are emphasized in the hydrogen production process to ensure eligibility for a subsidy, which is awarded if the proportion of nonrenewable electricity usage stays under a predetermined threshold. We solve the multistage stochastic optimization problem using a decomposition method based on Lagrange duality. The numerical results indicate that the solution to this problem, formulated as a policy, achieves a small duality gap, thus proving the effectiveness of this approach.

math.OC↗

arXiv2023

Time Blocks Decomposition of Multistage Stochastic Optimization Problems

Multistage stochastic optimization problems are, by essence, complex as their solutions are indexed both by stages and by uncertainties. Their large scale nature makes decomposition methods appealing, like dynamic programming which is a sequential decomposition using a state variable defined at all stages. In this paper, we introduce the notion of state reduction by time blocks, that is, at stages that are not necessarily all the original stages. Then, we prove a reduced dynamic programming equation. We position our result with respect to the most well-known mathematical frameworks for dynamic programming. We illustrate our contribution by showing its potential for applied problems with two time scales.

math.OC↗

arXiv2023

Decomposition Methods for Dynamically Monotone Two-Time-Scale Stochastic Optimization Problems

In energy management, it is common that strategic investment decisions (storage capacity, production units) are made at a slow time scale, whereas operational decisions (storage, production) are made at a fast time scale: for such problems, the total number of decision stages may be huge. In this paper, we consider multistage stochastic optimization problems with two time-scales, and we propose a time block decomposition scheme to address them numerically. More precisely, our approach relies on two assumptions. On the one hand, we suppose slow time scale stagewise independence of the noise process: the random variables that occur during a slow time scale interval are independent of those at another slow time scale interval. This makes it possible to use Dynamic Programming at the slow time scale. On the other hand, we suppose a dynamically monotone property for the problem under consideration, which makes it possible to obtain bounds. Then, we present two algorithmic methods to compute upper and lower bounds for slow time scale Bellman value functions. Both methods rely respectively on primal and dual decomposition of the Bellman equation applied at the slow time scale. We assess the methods tractability and validate their efficiency by solving a battery management problem where the fast time scale operational decisions have an impact on the storage current capacity, hence on the strategic decisions to renew the battery at the slow time scale.

math.OC↗

arXiv2023

Contributions on complexity bounds for Deterministic Partially Observed Markov Decision Process

Markov Decision Processes (Mdps) form a versatile framework used to model a wide range of optimization problems. The Mdp model consists of sets of states, actions, time steps, rewards, and probability transitions. When in a given state and at a given time, the decision maker's action generates a reward and determines the state at the next time step according to the probability transition function. However, Mdps assume that the decision maker knows the state of the controlled dynamical system. Hence, when one needs to optimize controlled dynamical systems under partial observation, one often turns toward the formalism of Partially Observed Markov Decision Processes (Pomdp). Pomdps are often untractable in the general case as Dynamic Programming suffers from the curse of dimensionality. Instead of focusing on the general Pomdps, we present a subclass where transitions and observations mappings are deterministic: Deterministic Partially Observed Markov Decision Processes (Det-Pomdp). That subclass of problems has been studied by (Littman, 1996) and (Bonet, 2009). It was first considered as a limit case of Pomdps by Littman, mainly used to illustrate the complexity of Pomdps when considering as few sources of uncertainties as possible. In this paper, we improve on Littman's complexity bounds. We then introduce and study an even simpler class: Separated Det-Pomdps and give some new complexity bounds for this class. This new class of problems uses a property of the dynamics and observation to push back the curse of dimensionality.

math.OC↗

arXiv2022

Differentiability and Regularization of Parametric Convex Value Functions in Stochastic Multistage Optimization

In multistage decision problems, it is often the case that an initial strategic decision (such as investment) is followed by many operational ones (operating the investment). Such initial strategic decision can be seen as a parameter affecting a multistage decision problem. More generally, we study in this paper a standard multistage stochastic optimization problem depending on a parameter. When the parameter is fixed, Stochastic Dynamic Programming provides a way to compute the optimal value of the problem. Thus, the value function depends both on the state (as usual) and on the parameter. Our aim is to investigate on the possibility to efficiently compute gradients of the value function with respect to the parameter, when these objects exist. When nondifferentiable, we propose a regularization method based on the Moreau-Yosida envelope. We present a numerical test case from day-ahead power scheduling.

math.OC↗

arXiv2022

Multistage Optimization of a Petroleum Production System with Material Balance Model

In this paper, we propose a mathematical formulation for the management of an oil production network as a multistage optimization problem. The reservoir is modeled as a controlled dynamical system by using material balance equations. We use a dynamic programming algorithm to solve the optimization problem. Two numerical applications illustrate our work: the first one consists in optimizing the production of a gas reservoir, whereas the second one tackles an oil reservoir with water injection.

math.OC↗

arXiv2022

Time Consistency for Multistage Stochastic Optimization Problems under Constraints in Expectation

We consider sequences-indexed by time (discrete stages)-of families of multistage stochastic optimization problems. At each time, the optimization problems in a family are parameterized by some quantities (initial states, constraint levels.. .). In this framework, we introduce an adapted notion of time consistent optimal solutions, that is, solutions that remain optimal after truncation of the past and that are optimal for any values of the parameters. We link this time consistency notion with the concept of state variable in Markov Decision Processes for a class of multistage stochastic optimization problems incorporating state constraints at the final time, either formulated in expectation or in probability. For such problems, when the primitive noise random process is stagewise independent and takes a finite number of values, we show that time consistent solutions can be obtained by considering a finite dimensional state variable. We illustrate our results on a simple dam management problem.

math.OC↗

arXiv2022

The stochastic Auxiliary Problem Principle in Banach spaces: measurability and convergence

The stochastic Auxiliary Problem Principle (APP) algorithm is a general Stochastic Approximation (SA) scheme that turns the resolution of an original optimization problem into the iterative resolution of a sequence of auxiliary problems. This framework has been introduced to design decomposition-coordination schemes but also encompasses many well-known SA algorithms such as stochastic gradient descent or stochastic mirror descent. We study the stochastic APP in the case where the iterates lie in a Banach space and we consider an additive error on the computation of the subgradient of the objective. In order to derive convergence results or efficiency estimates for a SA scheme, the iterates must be random variables. This is why we prove the measurability of the iterates of the stochastic APP algorithm. Then, we extend convergence results from the Hilbert space case to the Banach space case. Finally, we derive efficiency estimates for the function values taken at the averaged sequence of iterates or at the last iterate, the latter being obtained by adapting the concept of modified Fej{é}r monotonicity to our framework.

math.OC↗

arXiv2022

Optimization of a domestic microgrid equipped with solar panel and battery: Model Predictive Control and Stochastic Dual Dynamic Programming approaches

In this study, a microgrid with storage (battery, hot water tank) and solar panel is considered. We benchmark two algorithms, MPC and SDDP, that yield online policies to manage the microgrid, and compare them with a rule based policy. Model Predictive Control (MPC) is a well-known algorithm which models the future uncertainties with a deterministic forecast. By contrast, Stochastic Dual Dynamic Programming (SDDP) models the future uncertainties as stagewise independent random variables with known probability distributions. We present a scheme, based on out-of-sample validation, to fairly compare the two online policies yielded by MPC and SDDP. Our numerical studies put to light that MPC and SDDP achieve significant gains compared to the rule based policy, and that SDDP overperforms MPC not only on average but on most of the out-of-sample assessment scenarios.

math.OC↗

arXiv2021

EMSx: a numerical benchmark for energy management systems

Inserting renewable energy in the electric grid in a decentralized manneris a key challenge of the energy transition. However, at local scale, both production and demand display erratic behavior, which makes it delicate to match them. It is the goal of Energy Management Systems (EMS) to achieve such balance at least cost. We present EMSx, a numerical benchmark for testing control algorithms for the management of electric microgrids equipped with a photovoltaic unit and an energy storage system. EMSx is made of three key components: the EMSx dataset, provided by Schneider Electric, contains a diverse pool of realistic microgrids with a rich collection of historical observations and forecasts; the EMSx mathematical framework is an explicit description of the assessment of electric microgrid control techniques and algorithms; the EMSx software EMSx.jl is a package, implemented in the Julia language, which enables to easily implement a microgrid controller and to test it. All components of the benchmark are publicly available, so that other researchers willing to test controllers on EMSx may reproduce experiments easily. Eventually, we showcase the results of standard microgrid control methods, including Model Predictive Control, Open Loop Feedback Control and Stochastic Dynamic Programming.

math.OC↗

arXiv2021

Mixed Spatial and Temporal Decompositions for Large Scale Multistage Stochastic Optimization Problems

We consider multistage stochastic optimization problems involving multiple units. Each unit is a (small) control system. Static constraints couple units at each stage. We present a mix of spatial and temporal decompositions to tackle such large scale problems. More precisely, we obtain theoretical bounds and policies by means of two methods, depending whether the coupling constraints are handled by prices or by resources. We study both centralized and decentralized information structures. We report the results of numerical experiments on the management of urban microgrids. It appears that decomposition methods are much faster and give better results than the standard Stochastic Dual Dynamic Programming method, both in terms of bounds and of policy performance.

math.OC↗

arXiv2021

Decentralized Multistage Optimization of Large-Scale Microgrids under Stochasticity

Microgrids are recognized as a relevant tool to absorb decentralized renewable energies in the energy mix. However, the sequential handling of multiple stochastic productions and demands, and of storage, make their management a delicate issue. We add another layer of complexity by considering microgrids where different buildings stand at the nodes of a network and are connected by the arcs; some buildings host local production and storage capabilities, and can exchange with others their energy surplus. We formulate the problem as a multistage stochastic optimization problem, corresponding to the minimization of the expected temporal sum of operational costs, while satisfying the energy demand at each node, for all time. The resulting mathematical problem has a large-scale nature, exhibiting both spatial and temporal couplings. However, the problem displays a network structure that makes it amenable to a mix of spatial decomposition-coordination with temporal decomposition methods. We conduct numerical simulations on microgrids of different sizes and topologies, with up to 48 nodes and 64 state variables. Decomposition methods are faster and provide more efficient policies than a state-of-the-art Stochastic Dual Dynamic Programming algorithm. Moreover, they scale almost linearly with the state dimension, making them a promising tool to address more complex microgrid optimal management problems.

math.OC↗

arXiv2021

A Decomposition Method by Interaction Prediction for the Optimization of Maintenance Scheduling

Optimizing maintenance scheduling is a major issue to improve the performance of hydropower plants. We study a system of several physical components of the same family: either a set of turbines, a set of transformers or a set of generators. The components share a common stock of spare parts and experience random failures that occur according to known failure distributions. We seek a deterministic preventive maintenance strategy that minimizes an expected cost depending on maintenance and forced outages of the system. The Auxiliary Problem Principle is used to decompose the original large-scale optimization problem into a sequence of independent subproblems of smaller dimension while ensuring their coordination. Each subproblem consists in optimizing the maintenance on a single component. Decomposition-coordination techniques are based on variational techniques but the maintenance optimization problem is a mixed-integer problem. Therefore, we relax the dynamics and the cost functions of the system. The resulting algorithm iteratively solves the subproblems on the relaxed system with a blackbox method and coordinates the components. Relaxation parameters have an important influence on the optimization and must be appropriately chosen. An admissible maintenance strategy is then derived from the resolution of the relaxed problem. We apply the decomposition algorithm on a system with 80 components. It outperforms the reference blackbox method applied directly on the original problem.

math.OC↗

arXiv2019

Upper and Lower Bounds for Large Scale Multistage Stochastic Optimization Problems: Application to Microgrid Management

We consider a microgrid where different prosumers exchange energy altogether by the edges of a given network. Each prosumer is located to a node of the network and encompasses energy consumption, energy production and storage capacities (battery, electrical hot water tank). The problem is coupled both in time and in space, so that a direct resolution of the problem for large microgrids is out of reach (curse of dimensionality). By affecting price or resources to each node in the network and resolving each nodal sub-problem independently by Dynamic Programming, we provide decomposition algorithms that allow to compute a set of decomposed local value functions in a parallel manner. By summing the local value functions together, we are able, on the one hand, to obtain upper and lower bounds for the optimal value of the problem, and, on the other hand, to design global admissible policies for the original system. Numerical experiments are conducted on microgrids of different size, derived from data given by the research and development centre Efficacity, dedicated to urban energy transition. These experiments show that the decomposition algorithms give better results than the standard SDDP method, both in terms of bounds and policy values. Moreover, the decomposition methods are much faster than the SDDP method in terms of computation time, thus allowing to tackle problem instances incorporating more than 60 state variables in a Dynamic Programming framework.

math.OC↗