Searcharxiv⌕ Search

arXiv subjects

Thanh Long Vu

Publications and source records attributed to Thanh Long Vu.

At least 19 recordsLinked to original sources

A Hybrid Two-Stage Machine Learning Pipeline for Fault Detection and Classification in Power Transmission Systems

Rapid and accurate fault detection in high-voltage transmission networks is essential for grid reliability and equipment protection. Transmission fault datasets are frequently imbalanced, and certain fault types produce electrical signatures that fall within the normal operating envelope, causing single-model classifiers to fail on safety-critical cases. This paper proposes a hybrid two-stage machine learning pipeline that decouples detection from classification. Stage 1 combines an Isolation Forest anomaly detector with an optional supervised binary detector through an OR-fusion rule; the supervised branch is allocated automatically during training for any fault class the anomaly detector cannot resolve, and is omitted when no such class exists. Stage 2 applies a Random Forest multiclass classifier only to samples flagged by Stage 1. Feature engineering is expressed as a per-measurement-point operator mapping six raw channels to eighteen features, including zero-sequence symmetrical components derived from Fortescue's theorem, yielding 18L features for L measurement points. On the TLFaultDataset, the pipeline raises Line-fault end-to-end accuracy from 31.3% to 95.8%. On an independent single-point dataset, the same framework attains 97.25% end-to-end accuracy across all classes including normal operation, exceeding the TLFed federated benchmark of 94.84% without GPU or federated infrastructure, at 0.05 ms per sample on CPU. Ablation on both datasets shows zero-sequence features resolving the three-phase versus three-phase-to-ground ambiguity, raising the F1-score of that class pair from 0.39 to 0.997. The direction of the zero-sequence signature is found to be system-dependent, motivating a learned decision boundary in place of a fixed relay threshold.

eess.SY↗

Risk-Constrained Reinforcement Learning for Inverter-Dominated Power System Controls

This paper develops a risk-aware controller for grid-forming inverters (GFMs) to minimize large frequency oscillations in GFM inverter-dominated power systems. To tackle the high variability from loads/renewables, we incorporate a mean-variance risk constraint into the classical linear quadratic regulator (LQR) formulation for this problem. The risk constraint aims to bound the time-averaged cost of state variability and thus can improve the worst-case performance for large disturbances. The resulting risk-constrained LQR problem is solved through the dual reformulation to a minimax problem, by using a reinforcement learning (RL) method termed as stochastic gradient-descent with max-oracle (SGDmax). In particular, the zero-order policy gradient (ZOPG) approach is used to simplify the gradient estimation using simulated system trajectories. Numerical tests conducted on the IEEE 68-bus system have validated the convergence of our proposed SGDmax for GFM model and corroborate the effectiveness of the risk constraint in improving the worst-case performance while reducing the variability of the overall control cost.

math.OC↗

Reinforcement Learning-based Output Structured Feedback for Distributed Multi-Area Power System Frequency Control

Load frequency control (LFC) is a key factor to maintain the stable frequency in multi-area power systems. As the modern power systems evolve from centralized to distributed paradigm, LFC needs to consider the peer-to-peer (P2P) based scheme that considers limited information from the information-exchange graph for the generator control of each interconnected area. This paper aims to solve a data-driven constrained LQR problem with mean-variance risk constraints and output structured feedback, and applies this framework to solve the LFC problem in multi-area power systems. By reformulating the constrained optimization problem into a minimax problem, the stochastic gradient descent max-oracle (SGDmax) algorithm with zero-order policy gradient (ZOPG) is adopted to find the optimal feedback gain from the learning, while guaranteeing convergence. In addition, to improve the adaptation of the proposed learning method to new or varying models, we construct an emulator grid that approximates the dynamics of a physical grid and performs training based on this model. Once the feedback gain is obtained from the emulator grid, it is applied to the physical grid with a robustness test to check whether the controller from the approximated emulator applies to the actual system. Numerical tests show that the obtained feedback controller can successfully control the frequency of each area, while mitigating the uncertainty from the loads, with reliable robustness that ensures the adaptability of the obtained feedback gain to the actual physical grid.

math.OC↗

Resilient Communication Scheme for Distributed Decision of InterconnectingNetworks of Microgrids

Networking of microgrids can provide the operational flexibility needed for the increasing number of DERs deployed at the distribution level and supporting end-use demand when there is loss of the bulk power system. But, networked microgrids are vulnerable to cyber-physical attacks and faults due to the complex interconnections. As such, it is necessary to design resilient control systems to support the operations of networked microgrids in responses to cyber-physical attacks and faults. This paper introduces a resilient communication scheme for interconnecting multiple microgrids to support critical demand, in which the interconnection decision can be made distributedly by each microgrid controller even in the presence of cyberattacks to some communication links or microgrid controllers. This scheme blends a randomized peer-to-peer communication network for exchanging information among controllers and resilient consensus algorithms for achieving reliable interconnection agreement. The network of 6 microgrids divided from a modified 123-node test distribution feeder is used to demonstrate the effectiveness of the proposed resilient communication scheme.

eess.SY↗

Grid-Forming Inverter-based Wind Turbine Generators: Comprehensive Review, Comparative Analysis, and Recommendations

High penetration of wind power with conventional grid following controls for inverter-based wind turbine generators (WTGs) weakens the power grid, challenging the power system stability. Grid-forming (GFM) controls are emerging technologies that can address such stability issues. Numerous methodologies of GFM inverters have been developed in the literature; however, their applications for WTGs have not been thoroughly explored. As WTGs need to incorporate multiple control functions to operate reliably in different operational regions, the GFM control should be appropriately developed for the WTGs. This paper presents a review of GFM controls for WTGs, which covers the latest developments in GFM controls and includes multi-loop and single-loop GFM, virtual synchronous machine-based GFM, and virtual inertia control-based GFM. A comparison study for these GFM-based WTGs regarding normal and abnormal operating conditions together with black-start capability is then performed. The control parameters of these GFM types are properly designed and optimized to enable a fair comparison. In addition, the challenges of applying these GFM controls to wind turbines are discussed, which include the impact of DC-link voltage control strategy and the current saturation algorithm on the GFM control performance, black-start capability, and autonomous operation capability. Finally, recommendations and future developments of GFM-based wind turbines to increase the power system reliability are presented.

eess.SY↗

Safe Reinforcement Learning for Grid Voltage Control

Under voltage load shedding has been considered as a standard approach to recover the voltage stability of the electric power grid under emergency conditions, yet this scheme usually trips a massive amount of load inefficiently. Reinforcement learning (RL) has been adopted as a promising approach to circumvent the issues; however, RL approach usually cannot guarantee the safety of the systems under control. In this paper, we discuss a couple of novel safe RL approaches, namely constrained optimization approach and Barrier function-based approach, that can safely recover voltage under emergency events. This method is general and can be applied to other safety-critical control problems. Numerical simulations on the 39-bus IEEE benchmark are performed to demonstrate the effectiveness of the proposed safe RL emergency control.

cs.LG↗

Coordinated Frequency and Voltage Regulation of Grid-Following and Grid-Forming Inverters

In a purely inverter-based microgrid, both grid-forming (GFM) and grid-following (GFL) inverters will have a crucial role to play in frequency/voltage regulation and maintaining power sharing through their grid support capabilities. Consequently, the coordination between these two technologies becomes increasingly important for optimal system performance. However, the existing work does not consider GFL's potential to participate in a secondary control in coordination with GFM, thus not able to utilize the full capability of inverter resources. In this paper, we show that it is possible to fully coordinate the GFL and GFM inverters to achieve accurate power sharing, frequency/voltage regulation, and circulating var mitigation in networked microgrids even without the support of any synchronous generators or the bulk power system. We use the leader-follower consensus framework to develop a GFM-GFL coordination control. The effectiveness of the proposed coordination is verified under different disturbances and communication degradation. In addition, we find that the proposed fully-coordinated secondary control outperforms other approaches such as un-coordinated and partially-coordinated secondary controls, in aspects of load sharing and frequency and voltage regulation. Overall, this study emphasizes the need and benefits of GFL-GFM coordination in microgrids.

eess.SY↗

Barrier Function-based Safe Reinforcement Learning for Emergency Control of Power Systems

Under voltage load shedding has been considered as a standard and effective measure to recover the voltage stability of the electric power grid under emergency and severe conditions. However, this scheme usually trips a massive amount of load which can be unnecessary and harmful to customers. Recently, deep reinforcement learning (RL) has been regarded and adopted as a promising approach that can significantly reduce the amount of load shedding. However, like most existing machine learning (ML)-based control techniques, RL control usually cannot guarantee the safety of the systems under control. In this paper, we introduce a novel safe RL method for emergency load shedding of power systems, that can enhance the safe voltage recovery of the electric power grid after experiencing faults. Unlike the standard RL method, the safe RL method has a reward function consisting of a Barrier function that goes to minus infinity when the system state goes to the safety bounds. Consequently, the optimal control policy, that maximizes the reward function, can render the power system to avoid the safety bounds. This method is general and can be applied to other safety-critical control problems. Numerical simulations on the 39-bus IEEE benchmark is performed to demonstrate the effectiveness of the proposed safe RL emergency control, as well as its adaptive capability to faults not seen in the training.

eess.SY↗

Imposing Robust Structured Control Constraint on Reinforcement Learning of Linear Quadratic Regulator

This paper discusses learning a structured feedback control to obtain sufficient robustness to exogenous inputs for linear dynamic systems with unknown state matrix. The structural constraint on the controller is necessary for many cyber-physical systems, and our approach presents a design for any generic structure, paving the way for distributed learning control. The ideas from reinforcement learning (RL) in conjunction with control-theoretic sufficient stability and performance guarantees are used to develop the methodology. First, a model-based framework is formulated using dynamic programming to embed the structural constraint in the linear quadratic regulator (LQR) setting along with sufficient robustness conditions. Thereafter, we translate these conditions to a data-driven learning-based framework - robust structured reinforcement learning (RSRL) that enjoys the control-theoretic guarantees on stability and convergence. We validate our theoretical results with a simulation on a multi-agent network with 6 agents.

eess.SY↗

Scalable Voltage Control using Structure-Driven Hierarchical Deep Reinforcement Learning

This paper presents a novel hierarchical deep reinforcement learning (DRL) based design for the voltage control of power grids. DRL agents are trained for fast, and adaptive selection of control actions such that the voltage recovery criterion can be met following disturbances. Existing voltage control techniques suffer from the issues of speed of operation, optimal coordination between different locations, and scalability. We exploit the area-wise division structure of the power system to propose a hierarchical DRL design that can be scaled to the larger grid models. We employ an enhanced augmented random search algorithm that is tailored for the voltage control problem in a two-level architecture. We train area-wise decentralized RL agents to compute lower-level policies for the individual areas, and concurrently train a higher-level DRL agent that uses the updates of the lower-level policies to efficiently coordinate the control actions taken by the lower-level agents. Numerical experiments on the IEEE benchmark 39-bus model with 3 areas demonstrate the advantages and various intricacies of the proposed hierarchical approach.

eess.SY↗

Safe Reinforcement Learning for Emergency LoadShedding of Power Systems

The paradigm shift in the electric power grid necessitates a revisit of existing control methods to ensure the grid's security and resilience. In particular, the increased uncertainties and rapidly changing operational conditions in power systems have revealed outstanding issues in terms of either speed, adaptiveness, or scalability of the existing control methods for power systems. On the other hand, the availability of massive real-time data can provide a clearer picture of what is happening in the grid. Recently, deep reinforcement learning(RL) has been regarded and adopted as a promising approach leveraging massive data for fast and adaptive grid control. However, like most existing machine learning (ML)-basedcontrol techniques, RL control usually cannot guarantee the safety of the systems under control. In this paper, we introduce a novel method for safe RL-based load shedding of power systems that can enhance the safe voltage recovery of the electric power grid after experiencing faults. Numerical simulations on the 39-bus IEEE benchmark is performed to demonstrate the effectiveness of the proposed safe RL emergency control, as well as its adaptive capability to faults not seen in the training.

eess.SY↗

Reinforcement Learning of Structured Control for Linear Systems with Unknown State Matrix

This paper delves into designing stabilizing feedback control gains for continuous linear systems with unknown state matrix, in which the control is subject to a general structural constraint. We bring forth the ideas from reinforcement learning (RL) in conjunction with sufficient stability and performance guarantees in order to design these structured gains using the trajectory measurements of states and controls. We first formulate a model-based framework using dynamic programming (DP) to embed the structural constraint to the Linear Quadratic Regulator (LQR) gain computation in the continuous-time setting. Subsequently, we transform this LQR formulation into a policy iteration RL algorithm that can alleviate the requirement of known state matrix in conjunction with maintaining the feedback gain structure. Theoretical guarantees are provided for stability and convergence of the structured RL (SRL) algorithm. The introduced RL framework is general and can be applied to any control structure. A special control structure enabled by this RL framework is distributed learning control which is necessary for many large-scale cyber-physical systems. As such, we validate our theoretical results with numerical simulations on a multi-agent networked linear time-invariant (LTI) dynamic system.

eess.SY↗

Robustness against Disturbances in Power Systems under Frequency Constraints

The wide deployment of renewable generation and the gradual decrease in the overall system inertia make modern power grids more vulnerable to transient instabilities and unacceptable frequency fluctuations. Time-domain simulation-based assessment of the system robustness against uncertain and stochastic disturbances is extremely time-consuming. In this paper, we develop an alternative approach, which has its roots in the input-output stability analysis for Lur'e systems. Our approach consists of a mathematically rigorous characterization of the external disturbances that the power system is transiently stable and the frequency constraints are not violated. The derived certificate is efficiently constructed via convex optimization and is shown to be non-conservative for different IEEE test cases.

math.OC↗

Contraction and Robustness of Continuous Time Primal-Dual Dynamics

The Primal-Dual (PD) algorithm is widely used in convex optimization to determine saddle points. While the stability of the PD algorithm can be easily guaranteed, strict contraction is nontrivial to establish in most cases. This work focuses on continuous, possibly non-autonomous PD dynamics arising in a network context, in distributed optimization, or in systems with multiple time-scales. We show that the PD algorithm is indeed strictly contracting in specific metrics and analyze its robustness establishing stability and performance guarantees for different approximate PD systems. We derive estimates for the performance of multiple time-scale multi-layer optimization systems, and illustrate our results on a primal-dual representation of the Automatic Generation Control of power systems.

math.OC↗

A Robustness Measure of Transient Stability under Operational Constraints in Power Systems

The aggressive integration of distributed renewable sources is changing the dynamics of the electric power grid in an unexpected manner. As a result, maintaining conventional performance specifications, such as transient stability, may not be sufficient to ensure its reliable operation in stressed conditions. In this paper, we introduce a novel criteria in transient stability with consideration of operational constraints over frequency deviation and angular separation. In addition, we provide a robustness measure of the region of attraction, which can quantify the ability of the post-fault system to remain synchronized even under disturbances. To assess this new stability specification, we adopt the notion of Input-to-State Stability (ISS) to the context of power systems and introduce a new class of convex Lyapunov functions, which will result in tractable convex-optimization-based stability certificates. As a result, we are able to quantify the level of disturbance a power system can withstand while maintaining its safe operation. We illustrate the introduced stability specification and certificate on the IEEE 9 bus system.

math.OC↗

Inverse Stability Problem and Applications to Renewables Integration

In modern power systems, the operating point, at which the demand and supply are balanced, may take different values due to changes in loads and renewable generation levels. Understanding the dynamics of stressed power systems with a range of operating points would be essential to assuring their reliable operation, and possibly allow higher integration of renewable resources. This letter introduces a non-traditional way to think about the stability assessment problem of power systems. Instead of estimating the set of initial states leading to a given operating condition, we characterize the set of operating conditions that a power grid converges to from a given initial state under changes in power injections and lines. We term this problem as "inverse stability", a problem which is rarely addressed in the control and systems literature, and hence, poorly understood. Exploiting quadratic approximations of the system's energy function, we introduce an estimate of the inverse stability region. Also, we briefly describe three important applications of the inverse stability notion: (i) robust stability assessment of power systems w.r.t. different renewable generation levels, (ii) stability-constrained optimal power flow (sOPF), and (iii) stability-guaranteed corrective action design.

eess.SY↗

Contraction Analysis of Nonlinear DAE Systems

This paper studies the contraction properties of nonlinear differential-algebraic equation (DAE) systems. Specifically we develop scalable techniques for constructing the attraction regions associated with a particular stable equilibrium, by establishing the relation between the contraction rates of the original systems and the corresponding virtual extended systems. We show that for a contracting DAE system, the reduced system always contracts faster than the extended ones; furthermore, there always exists an extension with contraction rate arbitrarily close to that of the original system. The proposed construction technique is illustrated with a power system example in the context of transient stability assessment.

math.DS↗

Structural Emergency Control Paradigm

Power grids normally operate at some stable operating condition where power supply and demand are balanced. In response to emergency situations, load shedding is a prevailing approach where local protective devices are activated to cut a suitable amount of load to quickly rebalance the supply demand and hopefully stabilize the system. This traditional emergency control results in interrupted service with severe economic damage to customers. Also, such control is usually less effective due to the lack of coordination among protective devices. In this paper, we propose a novel structural emergency control to render post-fault dynamics from the critical/emergency fault-cleared state to the stable equilibrium point. This is a new control paradigm that does not rely on any continuous measurement or load shedding, as in the classical setup. Instead, the grid is made stable by discretely relocating the equilibrium point and its stability region such that the system is consecutively attracted from the fault-cleared state back to the original equilibrium point. The proposed control is designed by solving linear and convex optimization problems, making it possibly scalable to large-scale power grids. Finally, this emergency control scheme can be implemented by exploiting transmission facilities available on the existing grids.

eess.SY↗