arXiv subjects

Federica Bellizio

Publications and source records attributed to Federica Bellizio.

4 recordsLinked to original sources

arXiv2026

Safe Deep Reinforcement Learning for Building Heating Control and Demand-side Flexibility

Buildings account for approximately 40% of global energy consumption, and with the growing share of intermittent renewable energy sources, enabling demand-side flexibility, particularly in heating, ventilation and air conditioning systems, is essential for grid stability and energy efficiency. This paper presents a safe deep reinforcement learning-based control framework to optimize building space heating while enabling demand-side flexibility provision for power system operators. A deep deterministic policy gradient algorithm is used as the core deep reinforcement learning method, enabling the controller to learn an optimal heating strategy through interaction with the building thermal model while maintaining occupant comfort, minimizing energy cost, and providing flexibility. To address safety concerns with reinforcement learning, particularly regarding compliance with flexibility requests, we propose a real-time adaptive safety-filter to ensure that the system operates within predefined constraints during demand-side flexibility provision. The proposed real-time adaptive safety filter guarantees full compliance with flexibility requests from system operators and improves energy and cost efficiency -- achieving up to 50% savings compared to a rule-based controller -- while outperforming a standalone deep reinforcement learning-based controller in energy and cost metrics, with only a slight increase in comfort temperature violations.

eess.SY↗

arXiv2026

Towards socio-techno-economic power systems with demand-side flexibility

Harnessing the demand-side flexibility in building and mobility sectors can help to better integrate renewable energy into power systems and reduce global CO2 emissions. Enabling this sector coupling can be achieved with advances in energy management, business models, control technologies, and power grids. The study of demand-side flexibility extends beyond engineering, spanning social science, economics, and power and control systems, which present both challenges and opportunities to researchers and engineers in these fields. This Review outlines recent trends and studies in social, economic, and technological advancements in power systems that leverage demand-side flexibility. We first provide a concept of a socio-techno-economic system with an abstraction of end-users, building and mobility sectors, control systems, electricity markets, and power grids. We discuss the interconnections between these elements, highlighting the importance of bidirectional flows of information and coordinated decision-making. We then emphasize that fully realizing demand-side flexibility necessitates deep integration across stakeholders and systems, moving beyond siloed approaches. Finally, we discuss the future directions in renewable-based power systems and control engineering to address key challenges from both research and practitioners' perspectives. A holistic approach for identifying, measuring, and utilizing demand-side flexibility is key to successfully maximizing its multi-stakeholder benefits but requires further transdisciplinary collaboration and commercially viable solutions for broader implementation.

eess.SY↗

arXiv2023

Regularised Learning with Selected Physics for Power System Dynamics

Due to the increasing system stability issues caused by the technological revolutions of power system equipment, the assessment of the dynamic security of the systems for changing operating conditions (OCs) is nowadays crucial. To address the computational time problem of conventional dynamic security assessment tools, many machine learning (ML) approaches have been proposed and well-studied in this context. However, these learned models only rely on data, and thus miss resourceful information offered by the physical system. To this end, this paper focuses on combining the power system dynamical model together with the conventional ML. Going beyond the classic Physics Informed Neural Networks (PINNs), this paper proposes Selected Physics Informed Neural Networks (SPINNs) to predict the system dynamics for varying OCs. A two-level structure of feed-forward NNs is proposed, where the first NN predicts the generator bus rotor angles (system states) and the second NN learns to adapt to varying OCs. We show a case study on an IEEE-9 bus system that considering selected physics in model training reduces the amount of needed training data. Moreover, the trained model effectively predicted long-term dynamics that were beyond the time scale of the collected training dataset (extrapolation).

eess.SY↗

arXiv2022

Value of Optimal Trip and Charging Scheduling of Commercial Electric Vehicle Fleets with Vehicle-to-Grid in Future Low Inertia Systems

The electrification of transport is seen as an important step in the global decarbonisation agenda. With such a large expected load on the power system from electric vehicles (EVs), it is important to coordinate charging in order to balance the supply and demand for electricity. Bidirectional charging, enabled through Vehicle-to-Grid (V2G) technology, will unlock significant storage capacity from stationary EVs that are plugged in. To take this concept a step further, this paper quantifies the potential revenues to be gained by a commercial EV fleet operator from simultaneously scheduling its trips on a day-ahead basis, as well as its charging. This allows the fleet to complete its trips (with user defined trip length and distance), while taking advantage of fluctuating energy and ancillary services prices. A mathematical framework for optimal trip scheduling is proposed, formulated as a mixed-integer linear program, and is applied to several relevant scenarios of the present and future British electricity system. It is demonstrated that an optimal journey start time can increase the revenue of commercial fleets by up to 38% in summer and 12% in winter. This means a single EV from the maintenance fleet can make additional annual revenue of up to £729. Flexible trip schedules are more valuable in the summer because keeping EVs plugged in during peak solar output will benefit the grid and the fleet operators the most. It was also found that a fleet of 5,000 EVs would result in the equivalent $\textrm{CO}_2$ of removing one Combined Cycle Gas Turbine from the system. This significant increase in revenue and carbon savings show this approach is worth investigating for potential future application.

eess.SY↗