arXiv subjects

Yonghua Song

Publications and source records attributed to Yonghua Song.

At least 19 recordsLinked to original sources

arXiv2026

Optimal Microgrid Operation with Open-cycle Ocean Thermal Energy Conversion for Islands

Ocean thermal energy conversion (OTEC) is a zero-carbon technology that harnesses the ocean's thermal gradient to generate electricity. Among OTEC variants, open-cycle OTEC is particularly attractive to island communities, as it can co-generate electricity and freshwater. This paper develops an integrated model that captures both the thermodynamic process of open-cycle OTEC and its operational role in an island microgrid. A two-stage robust scheduling model is formulated for the island microgrid, with a budget uncertainty set to capture the renewable output deviations. The resulting model is solved via an inexact column-and-constraint generation algorithm, which accelerates convergence by permitting inexact solutions of the first-stage problem in early iterations. Numerical experiments demonstrate that open-cycle OTEC can fully substitute for conventional generators on island microgrids and provide more reliable and dispatchable output than volatile renewable sources.

eess.SY↗

arXiv2025

Black-Start Power Capacity Sizing and Control Strategy for an Islanded DFIG Wind-to-Hydrogen System

This paper proposes a black-start method for an off-grid wind-to-hydrogen (W2H) system comprising a wind farm based on Doubly-Fed Induction Generators (DFIGs), proton exchange membrane fuel cells (PEMFCs) serving as the black-start power source, and a hydrogen production industry. The PEMFC is installed within the hydrogen industry to facilitate direct access to hydrogen fuel. Based on the microgrid topology and black-start scheme, this study innovatively sizes the rated capacity of the PEMFC through power flow analysis. The capacity must be sufficient to charge passive components such as transmission lines and transformers, provide rotor excitation, and supply wind turbine (WT) and electrolyzer (ELZ) auxiliaries during startup. The proposed system integrates wind-hydrogen coordinated control (WHCC) and hydrogen-storage coordinated control (HSCC). Under maximum power point tracking (MPPT) of the WTs, the ELZ follows power fluctuations to absorb wind output, ensuring stable voltage and frequency. Fixed-frequency control applied to either the DFIG or PEMFC converters enables DFIGs to retain conventional grid-following (GFL) operation, reducing converter development costs. For both control modes, this paper establishes the black-start sequence and formulates a comprehensive coordinated control strategy for the entire system. The entire control system is validated through simulations in MATLAB/Simulink. Results confirm that the calculated PEMFC capacity supports reliable black-start, while the black-start control strategy ensures smooth system self-startup. Furthermore, the coordinated control strategy maintains stable frequency and voltage under fluctuating wind power, demonstrating the practicality and robustness of the proposed approach.

eess.SY↗

arXiv2025

Economic Bidding Strategy of Electric Vehicles in Real-Time Electricity Markets based on Marginal Opportunity Value

The participation of electric vehicle (EV) aggregators in real-time electricity markets offers promising revenue opportunities through price-responsive energy arbitrage. A central challenge in economic bidding lies in quantifying the marginal opportunity value of EVs' charging and discharging decisions. This value is implicitly defined and dynamically shaped by uncertainties in electricity prices and availability of EV resources. In this paper, we propose an efficient bidding strategy that enables EV aggregators to generate market-compliant bids based on the underlying marginal value of energy. The approach first formulates the EV aggregator's power scheduling problem as a Markov decision process, linking the opportunity value of energy to the value function. Building on this formulation, we derive the probability distributions of marginal opportunity values across EVs' different energy states under stochastic electricity prices. These are then used to construct closed-form expressions for marginal charging values and discharging costs under both risk-neutral and risk-averse preferences. The resulting expressions support a fully analytical bid construction procedure that transforms marginal valuations into stepwise price-quantity bids without redundant computation. Case studies using real-world EV charging data and market prices demonstrate the effectiveness and adaptability of the proposed strategy.

math.OC↗

arXiv2025

Achieving Stability and Optimality: Control Strategy for a Wind Turbine Supplying an Electrolyzer in the Islanded Storage-less Microgrid

Wind power generation supplying electrolyzers in islanded microgrids is an essential technical pathway for green hydrogen production, attracting growing attention in the transition towards net zero carbon emissions. Both academia and industry widely recognize that islanded AC microgrids normally rely on battery energy storage systems (BESSs) for grid-forming functions. However, the high cost of BESS significantly increases the levelized cost of hydrogen (LCOH), compromising economic feasibility. To address this challenge and reduce the LCOH, this paper focuses on a wind turbine (WT) supplying an electrolyzer in a storage-less microgrid and identifies a unique characteristic that challenges the conventional understanding of this microgrid: active power is coupled with microgrid voltage rather than frequency, the latter being entirely decoupled from active power balance. Based on this unique characteristic, this paper develops a new control strategy that maintains power balance, stabilizes the voltage and frequency, and maximizes hydrogen production. The effectiveness of the control strategy is validated through case studies conducted in Matlab/Simulink, especially its capability to maintain stability while maximizing hydrogen production under various conditions.

eess.SY↗

arXiv2024

Safe Reinforcement Learning for Power System Control: A Review

The large-scale integration of intermittent renewable energy resources introduces increased uncertainty and volatility to the supply side of power systems, thereby complicating system operation and control. Recently, data-driven approaches, particularly reinforcement learning (RL), have shown significant promise in addressing complex control challenges in power systems, because RL can learn from interactive feedback without needing prior knowledge of the system model. However, the training process of model-free RL methods relies heavily on random decisions for exploration, which may result in ``bad" decisions that violate critical safety constraints and lead to catastrophic control outcomes. Due to the inability of RL methods to theoretically ensure decision safety in power systems, directly deploying traditional RL algorithms in the real world is deemed unacceptable. Consequently, the safety issue in RL applications, known as safe RL, has garnered considerable attention in recent years, leading to numerous important developments. This paper provides a comprehensive review of the state-of-the-art safe RL techniques and discusses how these techniques can be applied to power system control problems such as frequency regulation, voltage control, and energy management. We then present discussions on key challenges and future research directions, related to convergence and optimality, training efficiency, universality, and real-world deployment.

eess.SY↗

arXiv2023

Multi-Stage Expansion Planning for Decarbonizing Thermal Generation Supported Renewable Power Systems Using Hydrogen and Ammonia Storage

Large-scale centralized development of wind and solar energy and peer-to-grid transmission of renewable energy source (RES) via high voltage direct current (HVDC) has been regarded as one of the most promising ways to achieve goals of peak carbon and carbon neutrality in China. Traditionally, large-scale thermal generation is needed to economically support the load demand of HVDC with a given profile, which in turn raises concerns about carbon emissions. To address the issues above, hydrogen energy storage system (HESS) and ammonia energy storage system (AESS) are introduced to gradually replace thermal generation, which is represented as a multi-stage expansion planning (MSEP) problem. Specifically, first, HESS and AESS are established in the MSEP model with carbon emission reduction constraints, and yearly data with hourly time resolution are utilized for each stage to well describe the intermittence of RES. Then, a combined Dantzig-Wolfe decomposition (DWD) and column generation (CG) solution approach is proposed to efficiently solve the large-scale MSEP model. Finally, a real-life system in China is studied. The results indicate that HESS and AESS have the potential to handle the intermittence of RES, as well as the monthly imbalance between RES and load demand. Especially under the goal of carbon neutrality, the contribution of HESS and AESS in reducing levelized cost of energy (LCOE) reaches 12.28% and 14.59%, respectively, which finally leads to a LCOE of 0.4324 RMB/kWh.

eess.SY↗

arXiv2023

Optimal Sizing of Isolated Renewable Power Systems with Ammonia Synthesis: Model and Solution Approach

Isolated renewable power to ammonia (IRePtA) has been recognized as a promising way to decarbonize the chemical industry. Optimal sizing of the renewable power system is significant to improve the techno-economic of IRePtA since the investment of power sources exceeds 80\% of the total investment. However, multi-timescale electricity, hydrogen, and ammonia storages, minimum power supply for system safety, and the multi-year uncertainty of renewable generation lead to difficulties in planning. To address the issues above, an IGDT-MILFP model is proposed. First, the levelized cost of ammonia (LCOA) is directly formulated as the objective, rendering a mixed integer linear fractional programming (MILFP) problem. Information gap decision theory (IGDT) is utilized to handle the multi-year uncertainty of renewable generation. Second, a combined Charnes-Cooper (C&C) transformation and Branch-and-Bound (B&B) method is proposed to efficiently solve the large-scale IGDT-MILFP model, giving robust and opportunistic planning results. Then, Markov Chain Monte Carlo (MCMC) sampling-based posteriori analysis is leveraged to quantify the long-run performance. Finally, a real-life system in Inner Mongolia, China, is studied. The results indicate that the proposed methods could reduce the computational burden by orders of magnitude for solving a large-scale MILFP problem. Moreover, the proposed IGDT-MILFP model is necessary and accurate to obtain an optimal capacity allocation with the lowest expected LCOA (3610 RMB/t) in long-run simulations.

eess.SY↗

arXiv2023

Multi-timescale Trading Strategy for Renewable Power to Ammonia Virtual Power Plant in the Electricity, Hydrogen, and Ammonia Markets

Renewable power to ammonia (RePtA) is a prominent zero-carbon pathway for decarbonization. Due to the imbalance between renewables and production energy demand, the RePtA system relies on the electricity exchange with the power grid. Participating in the electricity market as a virtual power plant (VPP) may help to reduce energy costs. However, the power profile of local photovoltaics and wind turbines is similar to those in the market, resulting in rising energy costs under the conventional strategy. Hence, we develop a multi-timescale trading strategy for the RePtA VPP in the electricity, hydrogen, and ammonia markets. By utilizing the hydrogen and ammonia buffer systems, the RePtA VPP can optimally coordinate production planning. Moreover, we find it possible to describe the trading of electricity, ammonia, and hydrogen in a unified framework. The two-stage robust optimization model of the electricity market is extended to multiple markets and solved by the column and constraint generation (CC\&G) algorithm. The case is derived from an actual project in the Inner Mongolia Autonomous Region. Sensitivity analysis demonstrates the economic advantages of an RePtA VPP joining multiple markets over conventional strategy and reveals the necessity of the hydrogen and ammonia buffer and reactor's flexibility.

eess.SY↗

arXiv2022

Optimal Sizing and Pricing of Renewable Power to Ammonia Systems Considering the Limited Flexibility of Ammonia Synthesis

Converting renewable energy into ammonia has been recognized as a promising way to realize ``green hydrogen substitution" in the chemical industry. However, renewable power to ammonia (RePtA) requires an essential investment in facilities to provide a buffer against the strong volatility of renewable energy and the limited flexibility of ammonia synthesis, which involves the three main stakeholders, namely, power, hydrogen, and ammonia. Therefore, the sizing and pricing of RePtA play a core role in balancing the interest demands of investors. This paper proposes an optimal sizing and pricing method for RePtA system planning. First, power to ammonia (P2A) is modeled as a flexible load, especially considering the limited flexibility of ammonia synthesis, which has been verified using real dynamic regulation data. Second, the multi-investor economic (MIE) model is established considering both external and internal trading modes. Then, a two-stage decomposed sizing and pricing method is proposed to solve the problem caused by the strong coupling of planning, operation, and trading, and information gap decision theory (IGDT) method is utilized to handle the uncertainty of renewable generation. Finally, real data from a real-life system in Inner Mongolia are utilized to verify the proposed approach. The results show that the system proposed has a yield of 8.15%.

eess.SY↗

arXiv2022

Optimizing the Homogeneity and Efficiency of an SOEC Based on Multiphysics Simulation and Data-driven Surrogate Model

Inhomogeneous current and temperature distributions are harmful to the durability of the solid oxide electrolysis cell (SOEC). Segmented SOEC experiments reveal that a high steam utilization, which is favorable for system efficiency, leads to local steam starvation and enhanced the inhomogeneity. It is necessary to consider inhomogeneity and efficiency jointly in optimization studies. Three-dimensional (3D) multiphysics models validated with experiments can simulate the inhomogeneity in a reliable manner, but they are unsuitable for optimization due to the high computational cost. This study proposes a method that combines segmented SOEC experiments, multiphysics simulation, and artificial intelligence to optimize the inhomogeneity and efficiency of SOEC jointly. A 3D cell model is first built and verified by segmented SOEC experiments. Then, fast neural network surrogate models are built from the simulation data and integrated into a multi-objective optimization problem. Its solutions form a Pareto front reflecting the conflicting relationships among different objectives. It is found that the down-stream current is 60%-65% of the up-stream current when the steam utilization is 0.7. To increase the steam utilization to 0.8, the down-stream current will further drop to 50%-60% of the up-stream current. The Pareto fronts enable system operators to achieve a balance between efficiency and inhomogeneity.

eess.SY↗

arXiv2022

Design of the PID temperature controller for an alkaline electrolysis system with time delays

Electrolysis systems use proportional-integral-derivative (PID) temperature controllers to maintain stack temperatures around set points. However, heat transfer delays in electrolysis systems cause manual tuning of PID temperature controllers to be time-consuming, and temperature oscillations often occur. This paper focuses on the design of the PID temperature controller for an alkaline electrolysis system to achieve fast and stable temperature control. A thermal dynamic model of an electrolysis system is established in the frequency-domain for controller designs. Based on this model, the temperature stability is analysed by the root distribution, and the PID parameters are optimized considering both the temperature overshoot and the settling time. The performance of the optimal PID controllers is verified through experiments. Furthermore, the simulation results show that the before-stack temperature should be used as the feedback variable for small lab-scale systems to suppress stack temperature fluctuations, and the after-stack temperature should be used for larger systems to improve the economy. This study is helpful in ensuring the temperature stability and control of electrolysis systems.

eess.SY↗

arXiv2022

Efficient constraint learning for data-driven active distribution network operation

Scheduling flexible sources to promote the integration of renewable generation is one fundamental problem for operating active distribution networks (ADNs). However, existing works are usually based on power flow models, which require network parameters (e.g., topology and line impedance) that may be unavailable in practice. To address this issue, we propose an efficient constraint learning method to operate ADNs. This method first trains multilayer perceptrons (MLPs) based on historical data to learn the mappings from decisions to constraint violations and power loss. Then, power flow constraints can be replicated by these MLPs without network parameters. We further prove that MLPs learn constraints by formulating a union of disjoint polytopes to approximate the corresponding feasible region. Thus, the proposed method can be interpreted as a piecewise linearization method, which also explains its desirable ability to replicate complex constraints. Finally, a two-step simplification method is developed to reduce its computational burden. The first step prunes away unnecessary polytopes from the union above. The second step drops redundant linear constraints for each retained polytope. Numerical experiments based on the IEEE 33- and 123-bus test systems validate that the proposed method can achieve desirable optimality and feasibility simultaneously with guaranteed computational efficiency.

math.OC↗

arXiv2022

Deep-quantile-regression-based surrogate model for joint chance-constrained optimal power flow with renewable generation

Joint chance-constrained optimal power flow (JCC-OPF) is a promising tool to manage uncertainties from distributed renewable generation. However, most existing works are based on power flow equations, which require accurate network parameters that may be unobservable in many distribution systems. To address this issue, this paper proposes a learning-based surrogate model for JCC-OPF with renewable generation. This model equivalently converts joint chance constraints in quantile-based forms and introduces deep quantile regression to replicate them, in which a multi-layer perceptron (MLP) is trained with a special loss function to predict the quantile of constraint violations. Another MLP is trained to predict the expected power loss. Then, the JCC-OPF can be formulated without network parameters by reformulating these two MLPs into mixed-integer linear constraints. To further improve its performance, two pre-processing steps, i.e., data augmentation and calibration, are developed. The former trains a simulator to generate more training samples for enhancing the prediction accuracy of MLPs. The latter designs a positive parameter to calibrate the predictions of MLPs so that the feasibility of solutions can be guaranteed. Numerical experiments based on the IEEE 33- and 123-bus systems validate that the proposed model can achieve desirable feasibility and optimality simultaneously with no need for network parameters.

math.OC↗

arXiv2022

Thermal Modelling and Controller Design of an Alkaline Electrolysis System under Dynamic Operating Conditions

Thermal management is vital for the efficient and safe operation of alkaline electrolysis systems. Traditional alkaline electrolysis systems use simple proportional-integral-differentiation (PID) controllers to maintain the stack temperature near the rated value. However, in renewable-to-hydrogen scenarios, the stack temperature is disturbed by load fluctuations, and the temperature overshoot phenomenon occurs which can exceed the upper limit and harm the stack. This paper focuses on the thermal modelling and controller design of an alkaline electrolysis system under dynamic operating conditions. A control-oriented thermal model is established in the form of a third-order time-delay process, which is used for simulation and controller design. Based on this model, we propose two novel controllers to reduce temperature overshoot: one is a current feed-forward PID controller (PID-I), the other is a model predictive controller (MPC). Their performances are tested on a lab-scale system and the experimental results are satisfying: the temperature overshoot is reduced by 2.2 degree with the PID-I controller, and no obvious overshoot is observed with the MPC controller. Furthermore, the thermal dynamic performance of an MW-scale alkaline electrolysis system is analyzed by simulation, which shows that the temperature overshoot phenomenon is more general in large systems. The proposed method allows for higher temperature set points which can improve system efficiency by 1%.

eess.SY↗

arXiv2022

Chance-constrained regulation capacity offering for HVAC systems under non-Gaussian uncertainties with mixture-model-based convexification

Heating, ventilation, and air-conditioning (HVAC) systems are ideal demand-side flexible resources to provide regulation services. However, finding the best hourly regulation capacity offers for HVAC systems in a power market ahead of time is challenging because they are affected by non-Gaussian uncertainties from regulation signals. Moreover, since HVAC systems need to frequently regulate their power according to regulation signals, numerous thermodynamic constraints are introduced, leading to a huge computational burden. This paper proposes a tractable chance-constrained model to address these challenges. It first develops a temporal compression approach, in which the extreme indoor temperatures in the operating hour are estimated and restricted in the comfortable range so that the numerous thermodynamic constraints can be compressed into only a few ones. Then, a novel convexification method is proposed to handle the non-Gaussian uncertainties. This method leverages the Gaussian mixture model to reformulate the chance constraints with non-Gaussian uncertainties on the left-hand side into deterministic non-convex forms. We further prove that these non-convex forms can be approximately convexified by second-order cone constraints with marginal optimality loss. Therefore, the proposed model can be efficiently solved with guaranteed optimality. Numerical experiments are conducted to validate the superiority of the proposed method.

math.OC↗

arXiv2022

Chance-constrained DC Optimal Power Flow with Non-Gaussian Distributed Uncertainties

Chance-constrained programming (CCP) is a promising approach to handle uncertainties in optimal power flow (OPF). However, conventional CCP usually assumes that uncertainties follow Gaussian distributions, which may not match reality. A few papers employed the Gaussian mixture model (GMM) to extend CCP to cases with non-Gaussian uncertainties, but they are only appropriate for cases with uncertainties on the right-hand side but not applicable to DC OPF that containing left-hand side uncertainties. To address this, we develop a tractable GMM-based chance-constrained DC OPF model. In this model, we not only leverage GMM to capture the probability characteristics of non-Gaussian distributed uncertainties, but also develop a linearization technique to reformulate the chance constraints with non-Gaussian distributed uncertainties on the left-hand side into tractable forms. A mathematical proof is further provided to demonstrate that the corresponding reformulation is a safe approximation of the original problem, which guarantees the feasibility of solutions.

math.OC↗

arXiv2021

District Cooling System Control for Providing Operating Reserve based on Safe Deep Reinforcement Learning

Heating, ventilation, and air conditioning (HVAC) systems are well proved to be capable to provide operating reserve for power systems. As a type of large-capacity and energy-efficient HVAC system (up to 100 MW), district cooling system (DCS) is emerging in modern cities and has huge potential to be regulated as a flexible load. However, strategically controlling a DCS to provide flexibility is challenging, because one DCS services multiple buildings with complex thermal dynamics and uncertain cooling demands. Improper control may lead to significant thermal discomfort and even deteriorate the power system's operation security. To address the above issues, we propose a model-free control strategy based on the deep reinforcement learning (DRL) without the requirement of accurate system model and uncertainty distribution. To avoid damaging "trial & error" actions that may violate the system's operation security during the training process, we further propose a safe layer combined to the DRL to guarantee the satisfaction of critical constraints, forming a safe-DRL scheme. Moreover, after providing operating reserve, DCS increases power and tries to recover all the buildings' temperature back to set values, which may probably cause an instantaneous peak-power rebound and bring a secondary impact on power systems. Therefore, we design a self-adaption reward function within the proposed safe-DRL scheme to constrain the peak-power effectively. Numerical studies based on a realistic DCS demonstrate the effectiveness of the proposed methods.

eess.SY↗

arXiv2021

Scheduling HVAC loads to promote renewable generation integration with a learning-based joint chance-constrained approach

The integration of distributed renewable generation (DRG) in distribution networks can be effectively promoted by scheduling flexible resources such as heating, ventilation, and air conditioning (HVAC) loads. However, finding the optimal scheduling for them is nontrivial because DRG outputs are highly uncertain. To address this issue, this paper proposes a learning-based joint chance-constrained approach to coordinate HVAC loads with DRG. Unlike cutting-edge works adopting individual chance constraints to manage uncertainties, this paper controls the violation probability of all critical constraints with joint chance constraints (JCCs). This joint manner can explicitly guarantee the operational security of the entire system based on operators' preferences. To overcome the intractability of JCCs, we first prove that JCCs can be safely approximated by robust constraints with proper uncertainty sets. A famous machine learning algorithm, one-class support vector clustering, is then introduced to construct a small enough polyhedron uncertainty set for these robust constraints. A linear robust counterpart is further developed based on the strong duality to ensure computational efficiency. Numerical results based on various distributed uncertainties confirm the advantages of the proposed method in optimality and feasibility.

eess.SY↗