arXiv subjects

Shuhua Gao

Publications and source records attributed to Shuhua Gao.

5 recordsLinked to original sources

arXiv2025

Diffusion-Modeled Reinforcement Learning for Carbon and Risk-Aware Microgrid Optimization

This paper introduces DiffCarl, a diffusion-modeled carbon- and risk-aware reinforcement learning algorithm for intelligent operation of multi-microgrid systems. With the growing integration of renewables and increasing system complexity, microgrid communities face significant challenges in real-time energy scheduling and optimization under uncertainty. DiffCarl integrates a diffusion model into a deep reinforcement learning (DRL) framework to enable adaptive energy scheduling under uncertainty and explicitly account for carbon emissions and operational risk. By learning action distributions through a denoising generation process, DiffCarl enhances DRL policy expressiveness and enables carbon- and risk-aware scheduling in dynamic and uncertain microgrid environments. Extensive experimental studies demonstrate that it outperforms classic algorithms and state-of-the-art DRL solutions, with 2.3-30.1% lower operational cost. It also achieves 28.7% lower carbon emissions than those of its carbon-unaware variant and reduces performance variability. These results highlight DiffCarl as a practical and forward-looking solution. Its flexible design allows efficient adaptation to different system configurations and objectives to support real-world deployment in evolving energy systems.

cs.LG↗

arXiv2023

On Solar Photovoltaic Parameter Estimation: Global Optimality Analysis and a Simple Efficient Differential Evolution Method

A large variety of sophisticated metaheuristic methods have been proposed for photovoltaic parameter extraction. Our aim is not to develop another metaheuristic method but to investigate two practically important yet rarely studied issues: (i) whether existing results are already globally optimal; (ii) whether a significantly simpler metaheuristic can achieve equally good performance. We take the two widely used I-V curve datasets for case studies. The first issue is addressed using a branch and bound algorithm, which certifies the global minimum rigorously or locates a fairly tight upper bound, despite its intolerable slowness. These values are useful references for fair evaluation and further development of metaheuristics. Next, extensive examination and comparison reveal that, perhaps surprisingly, an elementary differential evolution (DE) algorithm can either attain the global minimum certified above or obtain the best-known result. More attractively, the simple DE algorithm takes only a fraction of the runtime of state-of-the-art metaheuristic methods and is particularly preferable in time-sensitive applications. This novel, unusual, and notable finding also indicates that the employment of increasingly complicated metaheuristics might be somewhat overkilling for regular PV parameter estimation. Finally, we discuss the implications of these results for future research and suggest the simple DE method as the first choice for industrial applications.

eess.SY↗

arXiv2020

Infinite-Horizon Optimal Control of Switched Boolean Control Networks with Average Cost: An Efficient Graph-Theoretical Approach

This study investigates the infinite-horizon optimal control problem for switched Boolean control networks with an average-cost criterion. A primary challenge of this problem is the prohibitively high computational cost when dealing with large-scale networks. We attempt to develop a more efficient and scalable approach from a graph-theoretical perspective. First, a weighted directed graph structure called the $\textit{optimal state transition graph}$ (OSTG) is established, whose edges encode the optimal action for each one-step transition between states reachable from a given initial state subject to various constraints. Then, we reduce the infinite-horizon optimal control problem into a minimum mean cycle (MMC) problem in the OSTG. Finally, we develop a novel algorithm that can quickly find a particular MMC by resorting to Karp's algorithm in graph theory and construct afterward an optimal switching and control law based on state feedback. Time complexity analysis shows that our algorithm can outperform all existing methods in terms of time efficiency. A 16-node signaling network in leukemia is used as a benchmark to test its effectiveness. Results show that the proposed graph-theoretical approach is much more computationally efficient: it runs hundreds or even thousands of times faster than existing methods.

eess.SY↗

arXiv2020

Optimal Control of Boolean Control Networks with Discounted Cost: An Efficient Approach based on Deterministic Markov Decision Process

This paper deals with the infinite-horizon optimal control problem for Boolean control networks (BCNs) with a discounted-cost criterion. This problem has been investigated in existing studies with algorithms characterized by high computational complexity. We thus attempt to develop more efficient approaches for this problem from a deterministic Markov decision process (DMDP) perspective. First, we show the eligibility of a DMDP to model the control process of a BCN and the existence of an optimal solution. Next, two approaches are developed to handle the optimal control problem in a DMDP. One approach adopts the well-known value iteration algorithm, and the other resorts to the Madani's algorithm specifically designed for DMDPs. The latter approach can find an exact optimal solution and outperform existing methods in terms of time efficiency, while the former value iteration based approach usually obtains a near-optimal solution much faster than all others. The 9-state-4-input \textit{ara} operon network of the bacteria \textit{E. coli} is used to verify the effectiveness and performance of our approaches. Results show that both approaches can reduce the running time dramatically by several orders of magnitude compared with existing work.

eess.SY↗

arXiv2019

Finite-Horizon Optimal Control of Boolean Control Networks: A Unified Graph-Theoretical Approach

This paper investigates the finite-horizon optimal control (FHOC) problem of Boolean control networks (BCNs) from a graph theory perspective. We first formulate two general problems to unify various special cases studied in the literature: (i) the horizon length is $\textit{a priori}$ fixed; (ii) the horizon length is unspecified but finite for given destination states. Notably, both problems can incorporate time-variant costs, which are rarely considered in existing work, and a variety of constraints. The existence of an optimal control sequence is analyzed under mild assumptions. Motivated by BCNs' finite state space and control space, we approach the two general problems in an intuitive and efficient way under a graph-theoretical framework. A weighted state transition graph and its time-expanded variants are developed, and the equivalence between the FHOC problem and the shortest path problem in specific graphs is established rigorously. Two custom algorithms are developed to find the shortest path and construct the optimal control sequence with lower time complexity, though technically a classical shortest-path algorithm in graph theory is sufficient for all problems. Compared with existing algebraic methods, our graph-theoretical approach can achieve state-of-the-art time efficiency while targeting the most general problems. Furthermore, our approach is the first one capable of solving Problem (ii) with time-variant costs. Finally, the Ara operon genetic network in $\textit{E. coli}$ is used as a benchmark example to validate the effectiveness of our approach, and the results of two tasks show that our approach can dramatically reduce the running time.

math.OC↗