SearcharxivSearch

arXiv subjects

Qianwen Xu

Publications and source records attributed to Qianwen Xu.

7 recordsLinked to original sources

Converter-Grid Interaction Stability Guaranteed Safe Deep Reinforcement Learning for Energy Storage Systems in Grid Frequency Support

The growing integration of converter interfaced renewable energy resources (RESs) intensifies stability challenges. Energy storage system (ESS) can provide fast and flexible frequency support to mitigate frequency deviations. However, the interface converter of ESS may encounter converter-grid interaction stability issues. This paper proposes a converter-grid interaction stability guaranteed safe DRL (CIS-DRL) method for ESS integrated power systems to achieve frequency regulation. We first obtain a double DNN-based stability region to identify the guaranteed converter-grid interaction stability. Next, a novel converter-grid interaction stability Safe-TD3 (CIS-STD3) algorithm is designed that integrates a stability feasibility projection layer to map unsafe actions into stable action set before execution, enforcing converter-grid interaction stability as a hard constraint throughout learning process. The proposed approach enables ESS for grid frequency support with 100% converter-grid interaction stability without violations. Experimental results show that the proposed CIS-DRL method achieves improved frequency regulation performance while preventing unstable operating points, demonstrating its practical applicability for real time ESS frequency support.

eess.SY

Two-stage Coordinated Energy Management of Train Operation and Wayside Energy Storage System for Rail Power Supply Systems

The increasing electrification of railway power supply system (RPSS) intensify the operational and economic challenges at the railway power system interface. Energy storage systems (ESSs) can provide fast and flexible support to mitigate short term power spikes and to improve the energy management. However, achieving coordinated operation is challenged by the tight coupling among electrical railway operation and ESS dispatch under time-varying traction demand and network limits. This paper proposes a two-stage coordinated energy management method for electrified RPSSs that jointly optimizes railway system operation, train trajectories and ESS dispatch while explicitly accounting for traction power flow constraints. First, a day-ahead operation stage determines the train operating profiles and the ESS setting decisions to establish the baseline operating plan. Then, an intra-day rolling optimization stage based on adaptive weight economic-model predictive control (AWC-MPC) updates ESS dispatch under refreshed forecasts of traction demand and renewable output. A real Swedish railway case is utilized to minimize the energy purchase cost and the ESS cost while reducing peak grid power, demonstrating its practical applicability with 35.7% peak grid power demand and 28.8% total system cost reduction.

eess.SY

Review on Electric Railway System Optimization: Train Dynamic Scheduling, Energy Management, and Storage Integration

The modernization of railway systems is being driven by the need for greater efficiency, sustainability, and intelligent operation. In this review, recent advancements in dynamic scheduling, energy management, and energy storage systems (ESSs) integration within electric railway networks are analyzed. Optimization strategies for train scheduling and operation control are reviewed, with a focus on methods that reduce energy consumption and improve overall system performance. The role of energy storage technologies is analyzed in terms of energy management, peak shaving, and voltage and frequency control for practical application. The integration of artificial intelligence and advanced control strategies is also reviewed in electrified railway systems. This review provides a comprehensive overview of current research trends and outlines future directions for the development of resilient, energy efficient, and intelligent railway systems with ESSs integration.

eess.SY

Grid Integration of Gigawatt-Scale AI Data Centers under Connect-and-Manage

Emerging connect-and-manage interconnection practices allow gigawatt-scale artificial intelligence data centers (AIDCs) to connect to the transmission network without prior network upgrades, at the cost of real-time curtailment during grid stress. This paper formalizes the resulting AIDC-transmission system operator (TSO) coordination as a sequential request-acceptance protocol with an explicit curtailment variable and a strict information boundary between the two parties. Physical models are developed on both sides of the point of common coupling: the AIDC is decomposed into frontier training, batch training, and inference serving subclasses sharing on-site battery energy storage, capturing differentiated temporal flexibility; the transmission network is modeled via DC power flow with generator constraints and budget-constrained demand uncertainty. Because the TSO's acceptance mapping is opaque to the AIDC, a three-layer hierarchical architecture is formulated in which a learning-based planning layer generates power requests, the TSO evaluates each request through a robust acceptance mechanism, and a single-step execution optimizer enforces internal feasibility under the realized power budget. Case studies with a gigawatt-scale AIDC on the IEEE 39-bus system with Australian market data show that the framework reduces curtailment from 9.1% to 2.8% while preserving 98.1% frontier training workload, that batch training acts as the primary grid-elastic resource with the largest throughput swing during peak demand, and that the on-site battery provides curtailment buffering through active discharge and charge deferral.

eess.SY

Safety-Enhanced Self-Learning for Optimal Power Converter Control

Data-driven learning-based control methods such as reinforcement learning (RL) have become increasingly popular with recent proliferation of the machine learning paradigm. These methods address the parameter sensitiveness and unmodeled dynamics in model-based controllers, such as finite control-set model predictive control. RL agents are typically utilized in simulation environments, where they are allowed to explore multiple "unsafe" actions during the learning process. However, this type of learning is not applicable to online self-learning of controllers in physical power converters, because unsafe actions would damage them. To address this, this letter proposes a safe online RL-based control framework to autonomously find the optimal switching strategy for the power converters, while ensuring system safety during the entire self-learning process. The proposed safe online RL-based control is validated in a practical testbed on a two-level voltage source converter system, and the results confirm the effectiveness of the proposed method.

eess.SY

Going Deeper into Recognizing Actions in Dark Environments: A Comprehensive Benchmark Study

While action recognition (AR) has gained large improvements with the introduction of large-scale video datasets and the development of deep neural networks, AR models robust to challenging environments in real-world scenarios are still under-explored. We focus on the task of action recognition in dark environments, which can be applied to fields such as surveillance and autonomous driving at night. Intuitively, current deep networks along with visual enhancement techniques should be able to handle AR in dark environments, however, it is observed that this is not always the case in practice. To dive deeper into exploring solutions for AR in dark environments, we launched the UG2+ Challenge Track 2 (UG2-2) in IEEE CVPR 2021, with a goal of evaluating and advancing the robustness of AR models in dark environments. The challenge builds and expands on top of a novel ARID dataset, the first dataset for the task of dark video AR, and guides models to tackle such a task in both fully and semi-supervised manners. Baseline results utilizing current AR models and enhancement methods are reported, justifying the challenging nature of this task with substantial room for improvements. Thanks to the active participation from the research community, notable advances have been made in participants' solutions, while analysis of these solutions helped better identify possible directions to tackle the challenge of AR in dark environments.

cs.CV

EfficientFi: Towards Large-Scale Lightweight WiFi Sensing via CSI Compression

WiFi technology has been applied to various places due to the increasing requirement of high-speed Internet access. Recently, besides network services, WiFi sensing is appealing in smart homes since it is device-free, cost-effective and privacy-preserving. Though numerous WiFi sensing methods have been developed, most of them only consider single smart home scenario. Without the connection of powerful cloud server and massive users, large-scale WiFi sensing is still difficult. In this paper, we firstly analyze and summarize these obstacles, and propose an efficient large-scale WiFi sensing framework, namely EfficientFi. The EfficientFi works with edge computing at WiFi APs and cloud computing at center servers. It consists of a novel deep neural network that can compress fine-grained WiFi Channel State Information (CSI) at edge, restore CSI at cloud, and perform sensing tasks simultaneously. A quantized auto-encoder and a joint classifier are designed to achieve these goals in an end-to-end fashion. To the best of our knowledge, the EfficientFi is the first IoT-cloud-enabled WiFi sensing framework that significantly reduces communication overhead while realizing sensing tasks accurately. We utilized human activity recognition and identification via WiFi sensing as two case studies, and conduct extensive experiments to evaluate the EfficientFi. The results show that it compresses CSI data from 1.368Mb/s to 0.768Kb/s with extremely low error of data reconstruction and achieves over 98% accuracy for human activity recognition.

cs.NI