arXiv subjects

Pedro P. Vergara

Publications and source records attributed to Pedro P. Vergara.

51 records · Page 3Linked to original sources

arXiv2024

A Screening Method for Power System Inertia Zones Identification

The heterogeneous distribution of frequency support from dispersed renewable generation sources results in varying inertia within the system. The effects of disturbances exhibit non-uniform variations contingent upon the disturbance's location and the affected region's topology and inertia. A screening method for inertia-zone identification is proposed considering the combination of network structure and generator inertia distribution that will aid in comprehending the response of nodes to disturbances. The nodes' dynamic nodal weight (DNW) is defined using maximal entropy random walk that defines each node's spreading power dynamics. Further, a modified weighted kmeans++ clustering technique is proposed using DNW to obtain the equivalent spatial points of each zone and the system to parameterize the inertia status of each zone. The impact of the proposed scheme is justified by simulating a modified IEEE 39 bus system with doubly-fed induction generator (DFIG) integration in the real-time digital simulator.

eess.SY↗

arXiv2024

RL-ADN: A High-Performance Deep Reinforcement Learning Environment for Optimal Energy Storage Systems Dispatch in Active Distribution Networks

Deep Reinforcement Learning (DRL) presents a promising avenue for optimizing Energy Storage Systems (ESSs) dispatch in distribution networks. This paper introduces RL-ADN, an innovative open-source library specifically designed for solving the optimal ESSs dispatch in active distribution networks. RL-ADN offers unparalleled flexibility in modeling distribution networks, and ESSs, accommodating a wide range of research goals. A standout feature of RL-ADN is its data augmentation module, based on Gaussian Mixture Model and Copula (GMC) functions, which elevates the performance ceiling of DRL agents. Additionally, RL-ADN incorporates the Laurent power flow solver, significantly reducing the computational burden of power flow calculations during training without sacrificing accuracy. The effectiveness of RL-ADN is demonstrated using in different sizes of distribution networks, showing marked performance improvements in the adaptability of DRL algorithms for ESS dispatch tasks. This enhancement is particularly beneficial from the increased diversity of training scenarios. Furthermore, RL-ADN achieves a tenfold increase in computational efficiency during training, making it highly suitable for large-scale network applications. The library sets a new benchmark in DRL-based ESSs dispatch in distribution networks and it is poised to advance DRL applications in distribution network operations significantly. RL-ADN is available at: https://github.com/ShengrenHou/RL-ADN and https://github.com/distributionnetworksTUDelft/RL-ADN.

cs.LG↗

arXiv2024

Enhanced Optimal Power Flow Based Droop Control in MMC-MTDC Systems

Optimizing operational set points for modular multilevel converters (MMCs) in Multi-Terminal Direct Current (MTDC) transmission systems is crucial for ensuring efficient power distribution and control. This paper presents an enhanced Optimal Power Flow (OPF) model for MMC-MTDC systems, integrating a novel adaptive voltage droop control strategy. The strategy aims to minimize generation costs and DC voltage deviations while ensuring the stable operation of the MTDC grid by dynamically adjusting the system operation points. The modified Nordic 32 test system with an embedded 4-terminal DC grid is modeled in Julia and the proposed control strategy is applied to the power model. The results demonstrate the feasibility and effectiveness of the proposed droop control strategy, affirming its potential value in enhancing the performance and reliability of hybrid AC-DC power systems.

eess.SY↗

arXiv2024

A Simulation Tool for V2G Enabled Demand Response Based on Model Predictive Control

Integrating electric vehicles (EVs) into the power grid can revolutionize energy management strategies, offering both challenges and opportunities for creating a more sustainable and resilient grid. In this context, model predictive control (MPC) emerges as a powerful tool for addressing the complexities of Grid-to-vehicle (G2V) and vehicle-to-grid (V2G) enabled demand response management. By leveraging advanced optimization techniques, MPC algorithms can anticipate future grid conditions and dynamically adjust EV charging and discharging schedules to balance supply and demand while minimizing operational costs and maximizing flexibility. However, no standard tools exist to evaluate novel energy management strategies based on MPC approaches. Our research focuses on harnessing the potential of MPC in G2V and V2G applications, by providing a simulation tool that allows to maximize EV flexibility and support demand response initiatives while mitigating the impact on EV battery health. In this paper, we propose an open-source MPC controller for G2V and V2G-enabled demand response management. The proposed approach is capable of tackling the uncertainties inherent in demand response operations. Through extensive simulation and analysis, we demonstrate the efficacy of our approach in maximizing the benefits of G2V and V2G while assessing the impact on the longevity and reliability of EV batteries. Specifically, our controller enables Charge Point Operators (CPOs) to optimize EV charging and discharging schedules in real-time, taking into account fluctuating energy prices, grid constraints, and EV user preferences.

eess.SY↗

arXiv2024

EV2Gym: A Flexible V2G Simulator for EV Smart Charging Research and Benchmarking

As electric vehicle (EV) numbers rise, concerns about the capacity of current charging and power grid infrastructure grow, necessitating the development of smart charging solutions. While many smart charging simulators have been developed in recent years, only a few support the development of Reinforcement Learning (RL) algorithms in the form of a Gym environment, and those that do usually lack depth in modeling Vehicle-to-Grid (V2G) scenarios. To address the aforementioned issues, this paper introduces the EV2Gym, a realistic simulator platform for the development and assessment of small and large-scale smart charging algorithms within a standardized platform. The proposed simulator is populated with comprehensive EV, charging station, power transformer, and EV behavior models validated using real data. EV2Gym has a highly customizable interface empowering users to choose from pre-designed case studies or craft their own customized scenarios to suit their specific requirements. Moreover, it incorporates a diverse array of RL, mathematical programming, and heuristic algorithms to speed up the development and benchmarking of new solutions. By offering a unified and standardized platform, EV2Gym aims to provide researchers and practitioners with a robust environment for advancing and assessing smart charging algorithms.

cs.SE↗

arXiv2024

Quantum Neural Networks for Power Flow Analysis

This paper explores the potential application of quantum and hybrid quantum-classical neural networks in power flow analysis. Experiments are conducted using two datasets based on 4-bus and 33-bus test systems. A systematic performance comparison is also conducted among quantum, hybrid quantum-classical, and classical neural networks. The comparison is based on (i) generalization ability, (ii) robustness, (iii) training dataset size needed, (iv) training error, and (v) training process stability. The results show that the developed hybrid quantum-classical neural network outperforms both quantum and classical neural networks, and hence can improve deep learning-based power flow analysis in the noisy-intermediate-scale quantum (NISQ) and fault-tolerant quantum (FTQ) era.

quant-ph↗

arXiv2024

Tensor Power Flow Formulations for Multidimensional Analyses in Distribution Systems

In this paper, we present two multidimensional power flow formulations based on a fixed-point iteration (FPI) algorithm to efficiently solve hundreds of thousands of power flows in distribution systems. The presented algorithms are the base for a new TensorPowerFlow (TPF) tool and shine for their simplicity, benefiting from multicore \gls{cpu} and \gls{gpu} parallelization. We also focus on the mathematical convergence properties of the algorithm, showing that its unique solution is at the practical operational point, which is the solution of high-voltage and low-current. The proof is validated using numerical simulations showing the robustness of the FPI algorithm compared to the classical \gls{nr} approach. In the case study, a benchmark with different PF solution methods is performed, showing that for applications requiring a yearly simulation at 1-minute resolution the computation time is decreased by a factor of 164, compared to the NR in its sparse formulation.

eess.SY↗

arXiv2024

PowerFlowNet: Power Flow Approximation Using Message Passing Graph Neural Networks

Accurate and efficient power flow (PF) analysis is crucial in modern electrical networks' operation and planning. Therefore, there is a need for scalable algorithms that can provide accurate and fast solutions for both small and large scale power networks. As the power network can be interpreted as a graph, Graph Neural Networks (GNNs) have emerged as a promising approach for improving the accuracy and speed of PF approximations by exploiting information sharing via the underlying graph structure. In this study, we introduce PowerFlowNet, a novel GNN architecture for PF approximation that showcases similar performance with the traditional Newton-Raphson method but achieves it 4 times faster in the simple IEEE 14-bus system and 145 times faster in the realistic case of the French high voltage network (6470rte). Meanwhile, it significantly outperforms other traditional approximation methods, such as the DC relaxation method, in terms of performance and execution time; therefore, making PowerFlowNet a highly promising solution for real-world PF analysis. Furthermore, we verify the efficacy of our approach by conducting an in-depth experimental evaluation, thoroughly examining the performance, scalability, interpretability, and architectural dependability of PowerFlowNet. The evaluation provides insights into the behavior and potential applications of GNNs in power system analysis.

cs.LG↗

arXiv2023

Volt/VAR Optimization in the Presence of Attacks: A Real-Time Co-Simulation Study

Traditionally, Volt/VAR optimization (VVO) is performed in distribution networks through legacy devices such as on-load tap changers (OLTCs), voltage regulators (VRs), and capacitor banks. With the amendment in IEEE 1547 standard, distributed energy resources (DERs) can now provide reactive power support to the grid. For this, renewable energy-based DERs, such as PV, are interfaced with the distribution networks through smart inverters (SIs). Due to the intermittent nature of such resources, VVO transforms into a dynamic problem that requires extensive communication between the VVO controller and devices performing the VVO scheme. This communication, however, can be potentially tampered with by an adversary rendering the VVO ineffective. In this regard, it is important to assess the impact of cyberattacks on the VVO scheme. This paper develops a real-time co-simulation setup to assess the effect of cyberattacks on VVO. The setup consists of a real-time power system simulator, a communication network emulator, and a master controller in a system-in-the-loop (SITL) setup. The DNP3 communication protocol is adopted for the underlying communication infrastructure. The results show that corrupted communication messages can lead to violation of voltage limits, increased number of setpoint updates of VRs, and economic loss.

eess.SY↗

arXiv2023

A Constraint Enforcement Deep Reinforcement Learning Framework for Optimal Energy Storage Systems Dispatch

The optimal dispatch of energy storage systems (ESSs) presents formidable challenges due to the uncertainty introduced by fluctuations in dynamic prices, demand consumption, and renewable-based energy generation. By exploiting the generalization capabilities of deep neural networks (DNNs), deep reinforcement learning (DRL) algorithms can learn good-quality control models that adaptively respond to distribution networks' stochastic nature. However, current DRL algorithms lack the capabilities to enforce operational constraints strictly, often even providing unfeasible control actions. To address this issue, we propose a DRL framework that effectively handles continuous action spaces while strictly enforcing the environments and action space operational constraints during online operation. Firstly, the proposed framework trains an action-value function modeled using DNNs. Subsequently, this action-value function is formulated as a mixed-integer programming (MIP) formulation enabling the consideration of the environment's operational constraints. Comprehensive numerical simulations show the superior performance of the proposed MIP-DRL framework, effectively enforcing all constraints while delivering high-quality dispatch decisions when compared with state-of-the-art DRL algorithms and the optimal solution obtained with a perfect forecast of the stochastic variables.

eess.SY↗

arXiv2023

Impact of Dynamic Tariffs for Smart EV Charging on LV Distribution Network Operation

With a growing share of electric vehicles (EVs) in our distribution grids, the need for smart charging becomes indispensable to minimise grid reinforcement. To circumvent the associated capacity limitations, this paper evaluates the effectiveness of different levels of network constraints and different dynamic tariffs, including a dynamic network tariff. A detailed optimisation model is first developed for public charging electric vehicles in a representative Dutch low voltage (LV) distribution network, susceptible to congestion and voltage problems by 2050 without smart charging of EVs. Later, a detailed reflection is made to assess the influence of the modelled features on the distribution system operator (DSO), charge point operator (CPO) costs, and the EVs' final state-of-charge (SOC) for both mono- (V1G) and bi-directional (V2G) charging. Results show that the dynamic network tariff outperforms other flat tariffs by increasing valley-filling. Consequently, compared to regular day-ahead pricing, a {significant} reduction in the frequency of congestion in the lines is achieved. In addition, V2G ensures the joint optimum for different stakeholders causing adequate EV user satisfaction, decreased CPO costs compared to conventional charging and fewer violations of grid constraints for the DSOs.

eess.SY↗

arXiv2023

Optimal Energy System Scheduling Using A Constraint-Aware Reinforcement Learning Algorithm

The massive integration of renewable-based distributed energy resources (DERs) inherently increases the energy system's complexity, especially when it comes to defining its operational schedule. Deep reinforcement learning (DRL) algorithms arise as a promising solution due to their data-driven and model-free features. However, current DRL algorithms fail to enforce rigorous operational constraints (e.g., power balance, ramping up or down constraints) limiting their implementation in real systems. To overcome this, in this paper, a DRL algorithm (namely MIP-DQN) is proposed, capable of \textit{strictly} enforcing all operational constraints in the action space, ensuring the feasibility of the defined schedule in real-time operation. This is done by leveraging recent optimization advances for deep neural networks (DNNs) that allow their representation as a MIP formulation, enabling further consideration of any action space constraints. Comprehensive numerical simulations show that the proposed algorithm outperforms existing state-of-the-art DRL algorithms, obtaining a lower error when compared with the optimal global solution (upper boundary) obtained after solving a mathematical programming formulation with perfect forecast information; while strictly enforcing all operational constraints (even in unseen test days).

eess.SY↗

arXiv2023

Estimating Risk-Aware Flexibility Areas for EV Charging Pools via Stochastic AC-OPF

This paper introduces a stochastic AC-OPF (SOPF) for the flexibility management of electric vehicle (EV) charging pools in distribution networks under uncertainty. The SOPF considers discrete utility functions from charging pools as a compensation mechanism for eventual energy not served to their charging tasks. An application of the proposed SOPF is described where a distribution system operator (DSO) requires flexibility to each charging pool in a day-ahead time frame, minimizing the cost for flexibility while guaranteeing technical limits. Flexibility areas are defined for each charging pool and calculated as a function of a risk parameter involving the solution's uncertainty. Results show that all players can benefit from this approach, i.e., the DSO obtains a risk-aware solution, while charging pools/tasks perceive a reduction in the total energy payment due to flexibility services.

eess.SY↗

arXiv2022

Performance Comparison of Deep RL Algorithms for Energy Systems Optimal Scheduling

Taking advantage of their data-driven and model-free features, Deep Reinforcement Learning (DRL) algorithms have the potential to deal with the increasing level of uncertainty due to the introduction of renewable-based generation. To deal simultaneously with the energy systems' operational cost and technical constraints (e.g, generation-demand power balance) DRL algorithms must consider a trade-off when designing the reward function. This trade-off introduces extra hyperparameters that impact the DRL algorithms' performance and capability of providing feasible solutions. In this paper, a performance comparison of different DRL algorithms, including DDPG, TD3, SAC, and PPO, are presented. We aim to provide a fair comparison of these DRL algorithms for energy systems optimal scheduling problems. Results show DRL algorithms' capability of providing in real-time good-quality solutions, even in unseen operational scenarios, when compared with a mathematical programming model of the energy system optimal scheduling problem. Nevertheless, in the case of large peak consumption, these algorithms failed to provide feasible solutions, which can impede their practical implementation.

eess.SY↗

arXiv2022

Behind Closed Doors: Process-Level Rootkit Attacks in Cyber-Physical Microgrid Systems

Embedded controllers, sensors, actuators, advanced metering infrastructure, etc. are cornerstone components of cyber-physical energy systems such as microgrids (MGs). Harnessing their monitoring and control functionalities, sophisticated schemes enhancing MG stability can be deployed. However, the deployment of `smart' assets increases the threat surface. Power systems possess mechanisms capable of detecting abnormal operations. Furthermore, the lack of sophistication in attack strategies can render them detectable since they blindly violate power system semantics. On the other hand, the recent increase of process-aware rootkits that can attain persistence and compromise operations in undetectable ways requires special attention. In this work, we investigate the steps followed by stealthy rootkits at the process level of control systems pre- and post-compromise. We investigate the rootkits' precompromise stage involving the deployment to multiple system locations and aggregation of system-specific information to build a neural network-based virtual data-driven model (VDDM) of the system. Then, during the weaponization phase, we demonstrate how the VDDM measurement predictions are paramount, first to orchestrate crippling attacks from multiple system standpoints, maximizing the impact, and second, impede detection blinding system operator situational awareness.

eess.SY↗