SearcharxivSearch

arXiv subjects

Yunjie Gu

Publications and source records attributed to Yunjie Gu.

At least 19 recordsLinked to original sources

A Small-Gain-Like Framework for Large-Signal Stability Evaluation of Multi-Converter Systems

The increasing penetration of grid-connected converters has greatly altered the large-signal behavior of power systems. Their angle dynamics, shaped by diverse control algorithms and coupled through complex circuit interactions, pose substantial challenges to large-signal stability evaluation of multi-converter systems. To resolve this issue, the small-gain theorem, which characterizes the dissipation capability of interconnected systems (the small-gain-like property) via the individual dissipation capabilities of subsystems, is introduced to investigate transient angle motions in multi-converter systems. A large-signal model involving a set of interconnected relative angle motions is first developed, and the small-gain-like property is then established for multi-converter systems within certain angle limits, which further enables the construction of Lyapunov functions. Based on this, an ellipsoidal forward-invariant region is identified inside the angle-limit region, which serves as an effective estimate of the large-signal stability region for multi-converter systems. The method is further applied to a paralleled system and a four-converter system, where the large-signal stability boundaries are explicitly computed and subsequently validated through experiments. The proposed small-gain-like based large-signal stability evaluation method enables quantitative stability assessment in multi-converter systems with diverse control algorithms, which may provide a scalable framework for large-signal stability evaluation and parameter design in modern power systems.

eess.SY

Consideration of Control-Loop Interaction in Transient Stability of Grid-Following Inverters using Bandwidth Separation Method

Grid-following inverters have been widely adopted as a grid interface for renewable energy, and ensuring their small-signal and large-signal stability is critical to modern power systems. Their large-signal, or transient, stability is a significant challenge to analyze because of the interaction of the phase-locked loop (PLL), which must maintain synchronism with various outer-loop controllers. Simple analysis in which outer-loop controllers are idealized is insufficient, and the interactions between the nonlinear dynamics of the PLL and the dynamics of the DC-link voltage control (DVC), as well as the AC terminal voltage control (TVC) when present, must be considered. An asymptotic analysis approach, termed the bandwidth separation method, is proposed. This method enables simplification and order reduction of the original differential equations when sufficient bandwidth separation exists. Through this method, the interaction between the DVC and PLL is explicitly characterized, revealing that such interaction degrades system stability and shrinks the stability region. The analysis also indicates that voltage instability, rather than PLL loss of synchronization alone, is often the root cause of transient instability. Optimal bandwidth configurations for the PLL and DVC are identified under various grid fault conditions: a larger PLL bandwidth improves resilience to phase-jump faults, while a larger DVC bandwidth enhances tolerance to power fluctuations. In addition, the influence of the TVC loop is analyzed, showing that a high TVC bandwidth can mitigate the destabilizing effects of PLL-DVC interaction and further improve transient stability. All analytical findings are validated through hardware-in-the-loop (HIL) experiments.

eess.SY

Localization and Reshaping of Non-Minimum-Phase Zeros in Multi-Converter Systems

Non-minimum-phase (NMP) zeros in multi-converter power systems impose bandwidth ceilings on feedback control, yet quantifying them at the system level has been impractical because commercial converters withhold their internal controller models. This paper develops a Jacobian-based framework that decouples the NMP zeros from individual converter dynamics, proves them to be strictly real, and expresses their values as the singular values of a matrix constructed solely from the grid admittance matrix and steady-state power injections. Because these zeros govern the peak magnitude of the complementary sensitivity function, an exponential lower bound on this peak is derived as a function of the dominant zero, establishing that as the zero approaches the origin the stability margin degrades unavoidably. To counteract this degradation, a zero reshaping strategy is proposed that ranks converter nodes by their real participation factors and identifies the optimal site for voltage droop deployment without iterative search, steering the dominant zero away from the origin and thereby suppressing the sensitivity peak.

eess.SY

Large-Signal Stability of Power Systems with Mixtures of GFL, GFM and GSP Inverters

Grid-following (GFL) inverters have very different large-signal stability characteristics to synchronous generators, and convenient concepts such as the equal-area criterion and global energy function do not apply in the same way. Existing studies mainly focus on the synchronization stability of an individual GFL inverter, while interactions between multiple inverters are less often addressed. This paper elucidates the interaction mechanisms between heterogeneous inverters, covering GFL, grid-forming (GFM), and grid-supporting (GSP) types, to determine the stability boundaries of systems with mixed inverter compositions. The generalized large-signal model for two-inverter systems is derived for various inverter combinations. This paper establishes that systems containing GFL inverters do not admit a global energy function, fundamentally limiting the applicability of traditional direct methods. To overcome this barrier, a manifold method is employed to accurately determine the region of attraction (ROA). To address the computational complexity of the manifold method, reduced-order models of inverter are used based on multiscale analysis. The large-signal stability margin is assessed by the shortest distance from a stable equilibrium point (SEP) to the boundary of the ROA, which is called the stability radius (SR). Using the proposed framework, the analysis reults of two-inverter system show that both GFM and GSP inverters significantly enhance the large-signal stability of a two-inverter system where the other inverter is GFL, with GFM providing slightly superior performance. This improvement is attributed to the voltage support effects and is maximized when the GFM or GSP inverter is located at the midpoint of the transmission line, where the voltage is lowest. All findings in this paper are validated through both EMT simulations and power hardware-in-the-loop (PHIL) experiments.

eess.SY

Power Margin Ratio -- A Large-Signal System Strength Metric for Inverter-Based Resources-Dominated Power Systems

As the growing penetration of inverter-based resources (IBRs) in modern power systems, the system strength is decreasing. Due to the inherent difference in short-circuit capacity contributions of synchronous generators and inverters, the short-circuit ratio is not a one-size-fit-all metric to assess the system strength. Following the distinct dynamic behavior of the IBR in small- and large-signal disturbance, the system strength is separated accordingly. To address the large-signal system strength assessment, a control type-dependent metric, Power Margin Ratio (PMR), is proposed in this paper. PMR is defined as the ratio between the maximum power that can be injected to the system without causing any instability and the nominal power of the IBR. It can be obtained via power flow calculation with a modified algorithm. The theoretical foundation of PMR is established from the viewpoint of dynamical systems. PMR is identical to SCR for the single-plant-infinite-bus system, while presents advancement for multi-infeed power systems. Comprehensive case studies and discussions have validated that PMR reveals the large-signal system strength from a static perspective.

eess.SY

Histomorphology-Guided Prototypical Multi-Instance Learning for Breast Cancer WSI Classification

Histomorphology is crucial in cancer diagnosis. However, existing whole slide image (WSI) classification methods struggle to effectively incorporate histomorphology information, limiting their ability to capture key pathological features. Particularly when the number of instances within a bag is large and their features are complex, it becomes challenging to accurately identify instances decisive for the bag label, making these methods prone to interference from ambiguous instances. To address this limitation, we propose a novel Histomorphology-Guided Prototypical Multi-Instance Learning (HGPMIL) framework that explicitly learns histomorphology-guided prototypical representations by incorporating tumor cellularity, cellular morphology, and tissue architecture. Specifically, our approach consists of three key components: (1) estimating the importance of tumor-related histomorphology information at patch-level based on medical prior knowledge; (2) generating representative prototypes through histomorphology-prototypical clustering; and (3) enabling WSI classification through histomorphology-guided prototypical aggregation. HGPMIL adjusts the decision boundary by incorporating histomorphological importance to reduce instance label uncertainty, thereby reversely optimizing the bag-level boundary. Experimental results demonstrate its effectiveness, achieving high diagnostic accuracy for molecular subtyping, cancer subtyping and survival analysis. The code will be made available at https://github.com/Badgewho/HMDMIL.

cs.CV

The Intrinsic Communication in Power Systems: A New Perspective to Understand Synchronization Stability

Synchronization is an essential element in three-phase ac electric power systems. The large-scale integration of converter-interfaced resources leads to the power grid transformation from voltage-source-dominated to voltage-current-source-composite, which also raises new challenges to model and analyze the system synchronization. In this article, we present the intrinsic analogy of a power system to a communication system, which is here called power-communication isomorphism. Based on this isomorphism, we revisit power system synchronization stability from a communication perspective and thereby establish a theory that unifies the synchronization dynamics of heterogeneous power apparatuses. In particular, the proposed theory is used to interpret and analyze, for example, the different power control speeds of power apparatuses; the role of network line dynamics in synchronization analysis; and the synchronization capability of current-source-dominated (e.g., grid-following-converter-dominated) grids. The findings are verified on the IEEE 68-bus test system.

eess.SY

Whole-System First-Swing Stability of Inverter-Based Inertia-Free Power Systems

The emphasis on inertia for system stability has been a long-held tradition in conventional grids. The fast and flexible controllability of inverters opens up new possibilities. This paper investigates the {first-swing stability} of inverter-based inertia-free power systems. We illustrate that by replacing inertia with fast primary control (i.e. inertia-free), the first-swing stability region is greatly extended compared to the classic equal area criterion of inertia-rich systems. The extended stability region is fully decentralised and ensures whole-system stability for all swing modes across all timescales and interaction boundaries in a complex grid. The removal of inertia has impacts on frequency stability but these impacts can be well mitigated. The findings of the paper are proved mathematically and verified by simulation on the IEEE 68-bus system.

eess.SY

Descriptor State Space Modeling of Power Systems

State space is widely used for modeling power systems and analyzing their dynamics but it is limited to representing causal and proper systems in which the number of zeros does not exceed the number of poles. In other words, the system input, output, and state can not be freely selected. This limits how flexibly models are constructed, and in some circumstances, can introduce errors because of the addition of virtual elements in order to connect the mismatched ports of subsystem models. An extension known as descriptor state space can model both proper and improper systems and is a promising candidate for solving the noted problems. It facilitates a modular construction of power system models with flexible choice of ports of subsystems. Algorithms for mathematical manipulation of descriptor state space models are derived such as preforming inverse, connection, and transform. Corresponding physical interpretations are also given. Importantly, the proposed algorithms preserve the subsystem states in the whole system model, which therefore enables the analysis of root causes of instability and mode participation. Theoretical advances are validated by example power systems of varied scales including a single-inductor or -capacitor system, two-inductor or -capacitor system, and a modified IEEE 14-bus generator-inverter-composite system.

eess.SY

SHAQ: Incorporating Shapley Value Theory into Multi-Agent Q-Learning

Value factorisation is a useful technique for multi-agent reinforcement learning (MARL) in global reward game, however its underlying mechanism is not yet fully understood. This paper studies a theoretical framework for value factorisation with interpretability via Shapley value theory. We generalise Shapley value to Markov convex game called Markov Shapley value (MSV) and apply it as a value factorisation method in global reward game, which is obtained by the equivalence between the two games. Based on the properties of MSV, we derive Shapley-Bellman optimality equation (SBOE) to evaluate the optimal MSV, which corresponds to an optimal joint deterministic policy. Furthermore, we propose Shapley-Bellman operator (SBO) that is proved to solve SBOE. With a stochastic approximation and some transformations, a new MARL algorithm called Shapley Q-learning (SHAQ) is established, the implementation of which is guided by the theoretical results of SBO and MSV. We also discuss the relationship between SHAQ and relevant value factorisation methods. In the experiments, SHAQ exhibits not only superior performances on all tasks but also the interpretability that agrees with the theoretical analysis. The implementation of this paper is on https://github.com/hsvgbkhgbv/shapley-q-learning.

cs.LG

Shapley Q-value: A Local Reward Approach to Solve Global Reward Games

Cooperative game is a critical research area in the multi-agent reinforcement learning (MARL). Global reward game is a subclass of cooperative games, where all agents aim to maximize the global reward. Credit assignment is an important problem studied in the global reward game. Most of previous works stood by the view of non-cooperative-game theoretical framework with the shared reward approach, i.e., each agent being assigned a shared global reward directly. This, however, may give each agent an inaccurate reward on its contribution to the group, which could cause inefficient learning. To deal with this problem, we i) introduce a cooperative-game theoretical framework called extended convex game (ECG) that is a superset of global reward game, and ii) propose a local reward approach called Shapley Q-value. Shapley Q-value is able to distribute the global reward, reflecting each agent's own contribution in contrast to the shared reward approach. Moreover, we derive an MARL algorithm called Shapley Q-value deep deterministic policy gradient (SQDDPG), using Shapley Q-value as the critic for each agent. We evaluate SQDDPG on Cooperative Navigation, Prey-and-Predator and Traffic Junction, compared with the state-of-the-art algorithms, e.g., MADDPG, COMA, Independent DDPG and Independent A2C. In the experiments, SQDDPG shows a significant improvement on the convergence rate. Finally, we plot Shapley Q-value and validate the property of fair credit assignment.

cs.LG

Impedance-based Root-cause Analysis: Comparative Study of Impedance Models and Calculation of Eigenvalue Sensitivity

Impedance models of power systems are useful when state-space models of apparatus such as inverter-based resources (IBRs) have not been made available and instead only black-box impedance models are available. For tracing the root causes of poor damping and tuning modes of the system, the sensitivity of the modes to components and parameters are needed. The so-called critical admittance-eigenvalue sensitivity based on nodal admittance model has provided a partial solution but omits meaningful directional information. The alternative whole-system impedance model yields participation factors of shunt-connected apparatus with directional information that allows separate tuning for damping and frequency, yet do not cover series-connected components. This paper formalises the relationships between the two forms of impedance models and between the two forms of root-cause analysis. The calculation of system eigenvalue sensitivity in impedance models is further developed, which fills the gaps of previous research and establishes a complete theory of impedance-based root-cause analysis. The theoretical relationships and the tuning of parameters have been illustrated with a three-node passive network, a modified IEEE 14-bus network and a modified NETS-NYPS 68-bus network, showing that tools can be developed for tuning of IBR-rich power systems where only black-box impedance models are available.

eess.SY

Revisiting Grid-Forming and Grid-Following Inverters: A Duality Theory

Power electronic converters for integrating renewable energy resources into power systems can be divided into grid-forming and grid-following inverters. They possess certain similarities, but several important differences, which means that the relationship between them is quite subtle and sometimes obscure. In this article, a new perspective based on duality is proposed to create new insights. It successfully unifies the grid interfacing and synchronization characteristics of the two inverter types in a symmetric, elegant, and technology-neutral form. Analysis shows that the grid-forming and grid-following inverters are duals of each other in several ways including a) synchronization controllers: frequency droop control and phase-locked loop (PLL); b) grid-interfacing characteristics: current-following voltage-forming and voltage-following current-forming; c) swing characteristics: current-angle swing and voltage-angle swing; d) inner-loop controllers: output impedance shaping and output admittance shaping; and e) grid strength compatibility: strong-grid instability and weak-grid instability. The swing equations are also derived in dual form, which reveal the dynamic interaction between the grid strength, the synchronization controllers, and the inner-loop controllers. Insights are generated into cases of poor stability in both small-signal and transient/large-signal. The theoretical analysis and simulation results are used to illustrate cases for simple single-inverter-infinite-bus systems and a multi-inverter power network.

eess.SY

Multi-Agent Reinforcement Learning for Active Voltage Control on Power Distribution Networks

This paper presents a problem in power networks that creates an exciting and yet challenging real-world scenario for application of multi-agent reinforcement learning (MARL). The emerging trend of decarbonisation is placing excessive stress on power distribution networks. Active voltage control is seen as a promising solution to relieve power congestion and improve voltage quality without extra hardware investment, taking advantage of the controllable apparatuses in the network, such as roof-top photovoltaics (PVs) and static var compensators (SVCs). These controllable apparatuses appear in a vast number and are distributed in a wide geographic area, making MARL a natural candidate. This paper formulates the active voltage control problem in the framework of Dec-POMDP and establishes an open-source environment. It aims to bridge the gap between the power community and the MARL community and be a drive force towards real-world applications of MARL algorithms. Finally, we analyse the special characteristics of the active voltage control problems that cause challenges (e.g. interpretability) for state-of-the-art MARL approaches, and summarise the potential directions.

cs.LG

Dual Synchronous Generator: Inertial Current Source based Grid-Forming Solution for VSC

In order to improve dynamic characteristics of the power system with high-proportion renewable energy sources (RESs), it is necessary for the voltage source converter (VSC), interfaces of RESs, to provide inertial and frequency regulation. In practical applications, VSCs are better to be controlled as a current source due to its weak overcurrent capacity. According to the characteristic, a dual synchronous theory is proposed to analyze the synchronization between current sources in this paper. Based on dual synchronous idea, a dual synchronous generator (DSG) control is applied in VSC to form inertial current source. In addition, a braking control is embedded in DSG control to improve the transient stability of VSC. Finally, experimental results verify the effectiveness of the theory and the control method.

eess.SY

Participation Analysis in Impedance Models: The Grey-Box Approach for Power System Stability

This paper develops a grey-box approach to small-signal stability analysis of complex power systems that facilitates root-cause tracing without requiring disclosure of the full details of the internal control structure of apparatus connected to the system. The grey-box enables participation analysis in impedance models, which is popular in power electronics and increasingly accepted in power systems for stability analysis. The Impedance participation factor is proposed and defined in terms of the residue of the whole-system admittance matrix. It is proved that, the so defined impedance participation factor equals the sensitivity of the whole-system eigenvalue with respect to apparatus impedance. The classic state participation factor is related to the impedance participation factor via a chain-rule. Based on the chain-rule, a three-layer grey-box approach, with three degrees of transparency, is proposed for root-cause tracing to different depths, i.e. apparatus, states, and parameters, according to the available information. The association of impedance participation factor with eigenvalue sensitivity points to the re-tuning that would stabilize the system. The impedance participation factor can be measured in the field or calculated from the black-box impedance spectra with little prior knowledge required.

eess.SY

Mapping of Dynamics between Mechanical and Electrical Ports in SG-IBR Composite Grids

Power grids are traditionally dominated by synchronous generators (SGs) but are currently undergoing a major transformation through the increasing integration of inverter-based resources (IBRs). The SG-dominated grid is traditionally analyzed in a mechanical-centric view which ignores fast electrical dynamics and focuses on the torque-speed dynamics. By contrast, analysis of the emergent IBR-dominated grid usually takes the electrical-centric view which focuses on the voltage-current interaction. In this article, a port-mapping method is proposed to fill the gap between these approaches and combine them in a unified model. Specifically, the mechanical dynamics are mapped to the electrical impedance seen at the electrical port; and the electrical dynamics are also mapped to the torque coefficient seen at the mechanical port. The bidirectional mapping gives additional flexibility and insights to analyze the sub-system interactions in whole-system dynamics and guide the tuning of parameter. Application of the proposed method is illustrated in three cases with increasing scales, namely a single-SG-infinite-bus system, a single-IBR-weak-grid system, and a modified IEEE 14-bus SG-IBR composite system.

eess.SY

Modelling Hierarchical Structure between Dialogue Policy and Natural Language Generator with Option Framework for Task-oriented Dialogue System

Designing task-oriented dialogue systems is a challenging research topic, since it needs not only to generate utterances fulfilling user requests but also to guarantee the comprehensibility. Many previous works trained end-to-end (E2E) models with supervised learning (SL), however, the bias in annotated system utterances remains as a bottleneck. Reinforcement learning (RL) deals with the problem through using non-differentiable evaluation metrics (e.g., the success rate) as rewards. Nonetheless, existing works with RL showed that the comprehensibility of generated system utterances could be corrupted when improving the performance on fulfilling user requests. In our work, we (1) propose modelling the hierarchical structure between dialogue policy and natural language generator (NLG) with the option framework, called HDNO, where the latent dialogue act is applied to avoid designing specific dialogue act representations; (2) train HDNO via hierarchical reinforcement learning (HRL), as well as suggest the asynchronous updates between dialogue policy and NLG during training to theoretically guarantee their convergence to a local maximizer; and (3) propose using a discriminator modelled with language models as an additional reward to further improve the comprehensibility. We test HDNO on MultiWoz 2.0 and MultiWoz 2.1, the datasets on multi-domain dialogues, in comparison with word-level E2E model trained with RL, LaRL and HDSA, showing improvements on the performance evaluated by automatic evaluation metrics and human evaluation. Finally, we demonstrate the semantic meanings of latent dialogue acts to show the explanability for HDNO.

cs.CL