arXiv subjects

Wencong Su

Publications and source records attributed to Wencong Su.

27 records · Page 2Linked to original sources

arXiv2024

A Critical Review of Safe Reinforcement Learning Techniques in Smart Grid Applications

The high penetration of distributed energy resources (DERs) in modern smart power systems introduces unforeseen uncertainties for the electricity sector, leading to increased complexity and difficulty in the operation and control of power systems. As a cutting-edge machine learning technology, deep reinforcement learning (DRL) has been widely implemented in recent years to handle the uncertainty in power systems. However, in critical infrastructures such as power systems, safety issues always receive top priority, while DRL may not always meet the safety requirements of power system operators. The concept of safe reinforcement learning (safe RL) is emerging as a potential solution to overcome the shortcomings of conventional DRL in the operation and control of power systems. This study provides a rigorous review of the latest research efforts focused on safe RL to derive power system control policies while accounting for the unique safety requirements of power grids. Furthermore, this study highlights various safe RL algorithms applied in diverse applications within the power system sector, from single grid-connected power converters, residential smart homes, and buildings to large power distribution networks. For all methods outlined, a discussion on their bottlenecks, research challenges, and potential opportunities in the operation and control of power system applications is also presented. This review aims to support research in the area of safe RL algorithms, embracing smart power system operation with safety constraints amid high uncertainty from DERs.

eess.SY↗

arXiv2024

SDN-Based Dynamic Cybersecurity Framework of IEC-61850 Communications in Smart Grid

In recent years, critical infrastructure and power grids have experienced a series of cyber-attacks, leading to temporary, widespread blackouts of considerable magnitude. Since most substations are unmanned and have limited physical security protection, cyber breaches into power grid substations present a risk. Nowadays, software-defined network (SDN), a popular virtual network technology based on the OpenFlow protocol is being widely used in the substation automation system. However, the susceptibility of SDN architecture to cyber-attacks has exhibited a notable increase in recent years, as indicated by research findings. This suggests a growing concern regarding the potential for cybersecurity breaches within the SDN framework. In this paper, we propose a hybrid intrusion detection system (IDS)-integrated SDN architecture for detecting and preventing the injection of malicious IEC 61850-based generic object-oriented substation event (GOOSE) messages in a digital substation. Additionally, this program locates the fault's location and, as a form of mitigation, disables a certain port. Furthermore, implementation examples are demonstrated and verified using a hardware-in-the-loop (HIL) testbed that mimics the functioning of a digital substation.

cs.CR↗

arXiv2024

Machine Learning based Post Event Analysis for Cybersecurity of Cyber-Physical System

As Information and Communication Technology (ICT) equipment continues to be integrated into power systems, issues related to cybersecurity are increasingly emerging. Particularly noteworthy is the transition to digital substations, which is shifting operations from traditional hardwired-based systems to communication-based Supervisory Control and Data Acquisition (SCADA) system operations. These changes in the power system have increased the vulnerability of the system to cyber-attacks and emphasized its importance. This paper proposes a machine learning (ML) based post event analysis of the power system in order to respond to these cybersecurity issues. An artificial neural network (ANN) and other ML models are trained using transient fault measurements and cyber-attack data on substations. The trained models can successfully distinguish between power system faults and cyber-attacks. Furthermore, the results of the proposed ML-based methods can also identify 10 different fault types and the location where the event occurred.

eess.SY↗

arXiv2020

Large-Signal Stability Criteria in DC Power Grids with Distributed-Controlled Converters and Constant Power Loads

The increasing adoption of power electronic devices may lead to large disturbance and destabilization of future power systems. However, stability criteria are still an unsolved puzzle, since traditional small-signal stability analysis is not applicable to power electronics-enabled power systems when a large disturbance occurs, such as a fault, a pulse power load, or load switching. To address this issue, this paper presents for the first time the rigorous derivation of the sufficient criteria for large-signal stability in DC microgrids with distributed-controlled DC-DC power converters. A novel type of closed-loop converter controllers is designed and considered. Moreover, this paper is the first to prove that the well-known and frequently cited Brayton-Moser mixed potential theory (published in 1964) is incomplete. Case studies are carried out to illustrate the defects of Brayton-Moser mixed potential theory and verify the effectiveness of the proposed novel stability criteria.

eess.SY↗

arXiv2019

Adaptive Robust Energy Management Strategy for Campus-Based Commercial Buildings Considering Comprehensive Comfort Levels

Neglecting consumers' comfort always leads to failure or slow-response to demand response request. In this paper, we propose several comprehensive comfort level models for various appliances in campus-based commercial buildings (CBs). The objective of the proposed system is to minimize O\&M costs of campus-based CBs and maximize various comfort levels simultaneously under the worst-case scenarios. Adaptive robust optimization (ARO) is leveraged to handle various uncertainties within the proposed system: (i) demand response signals sending from the distribution system operator (DSO); (ii) arrival state-of-charge (SoC) conditions of plug-in electric vehicles (PEVs); (iii) power outputs of renewable energy sources (RESs); and (iv) load demand of other appliances. Benders decomposition, such as column-and-constraint generation (C\&CG) algorithm, is used to solve the reformulated NP-hard min-max problem. Extensive simulation results demonstrate the effectiveness of the proposed optimal energy management strategy for campus-based CBs in both minimizing O\&M costs and maximizing comprehensive comfort levels.

math.OC↗

arXiv2017

A Novel Consensus-based Distributed Algorithm for Economic Dispatch Based on Local Estimation of Power Mismatch

This paper proposes a novel consensus-based distributed control algorithm for solving the economic dispatch problem of distributed generators. A legacy central controller can be eliminated in order to avoid a single point of failure, relieve computational burden, maintain data privacy, and support plug-and-play functionalities. The optimal economic dispatch is achieved by allowing the iterative coordination of local agents (consumers and distributed generators). As coordination information, the local estimation of power mismatch is shared among distributed generators through communication networks and does not contain any private information, ultimately contributing to a fair electricity market. Additionally, the proposed distributed algorithm is particularly designed for easy implementation and configuration of a large number of agents in which the distributed decision making can be implemented in a simple proportional-integral (PI) or integral (I) controller. In MATLAB/Simulink simulation, the accuracy of the proposed distributed algorithm is demonstrated in a 29-node system in comparison with the centralized algorithm. Scalability and a fast convergence rate are also demonstrated in a 1400-node case study. Further, the experimental test demonstrates the practical performance of the proposed distributed algorithm using the VOLTTRON platform and a cluster of low-cost credit-card-size single-board PCs.

math.OC↗

arXiv2017

Control and Energy Management System in Microgrids

As a cutting-edge technology, microgrids feature intelligent EMSs and sophisticated control, which will dramatically change our energy infrastructure. The modern microgrids are a relatively recent development with high potential to bring distributed generation, DES devices, controllable loads, communication infrastructure, and many new technologies into the mainstream. As a more controllable and intelligent entity, a microgrid has more growth potential than ever before. However, there are still many open questions, such as the future business models and economics. What is the cost-benefit to the end-user? How should we systematically evaluate the potential benefits and costs of control and energy management in a microgrid?

eess.SY↗

arXiv2017

The Application of Distributed Control Algorithms using VOLTTRON-based Software Platform

This paper gives an insight into the applications of an open-source control system platform named VOLTTRON. This platform was developed by the Pacific Northwest National Laboratory. A brief introduction is given on the functionality and key features of the platform. Potential applications in the areas of building control and electric vehicle charging are stated, along with an overview of existing projects. A comparison is also made between VOLTTRON and other related software. An actual implementation case of VOLTTRON is then presented in the case study. The demonstration uses the VOLTTRON platform as a message bus. Decentralized generators and consumers are simulated by 16 single-board computers.

eess.SY↗

arXiv2017

Intelligent Home Energy Management System for Distributed Renewable Generators, Dispatchable Residential Loads and Distributed Energy Storage Devices

This paper presents an intelligent home energy management system integrated with dispatchable loads (e.g., clothes washers and dryers), distributed renewable generators (e.g., roof-top solar panels), and distributed energy storage devices (e.g., plug-in electric vehicles). The overall goal is to reduce the total operating costs and the carbon emissions for a future residential house, while satisfying the end-users comfort levels. This paper models a wide variety of home appliances and formulates the economic operation problem using mixed integer linear programming. Case studies are performed to validate and demonstrate the effectiveness of the proposed solution algorithm. Simulation results also show the positive impact of dispatchable loads, distributed renewable generators, and distributed energy storage devices on a future residential house.

math.OC↗