SearcharxivSearch

arXiv subjects

Majid Majidi

Publications and source records attributed to Majid Majidi.

3 recordsLinked to original sources

Scalable Grid-Aware Dynamic Matching using Deep Reinforcement Learning

This paper proposes a two-level hierarchical matching framework for Integrated Hybrid Resources (IHRs) with grid constraints. An IHR is a collection of Renewable Energy Sources (RES) and flexible customers within a certain power system zone, endowed with an agent to match. The key idea is to pick the IHR zones so that the power loss effects within the IHRs can be neglected. This simplifies the overall matching problem into independent IHR-level matching problems and an upper-level optimal power flow problem to meet the IHR-level upstream flow requirements while respecting the grid constraints. Within each IHR, the agent employs a scalable Deep Reinforcement Learning algorithm to identify matching solutions such that the customer's service constraints are met. The central agent then solves an optimal power flow problem with the IHRs as the nodes, with their active power flow and reactive power {capacities}, and grid constraints to scalably determine the final flows such that matched power can be delivered to the extent the grid constraints are satisfied. The proposed framework is implemented on a test power distribution system, and multiple case studies are presented to substantiate the welfare efficiency of the proposed solution and the satisfaction of the grid and customers' servicing constraints.

eess.SY

Dynamic Matching Markets in Power Grid: Concepts and Solution using Deep Reinforcement Learning

Traditional bulk load flexibility options, such as load shifting and load curtailment, for managing uncertainty in power markets limit the diversity of options and ignore the preferences of the individual loads, thus reducing efficiency and welfare. This paper proposes an alternative to bulk load flexibility options for managing uncertainty in power markets: a reinforcement learning based dynamic matching market. We propose a novel hybrid learning-based model for maximizing social welfare in the dynamic matching market. The key features of our model is a fixed rule-based function and a learnable component that can be trained by data gathered online with no prior knowledge or expert supervision. The output of the learnable component is a probability distribution over the matching decisions for the individual customers. The proposed hybrid model enables the learning algorithm to find an effective matching policy that simultaneously satisfies the customers' servicing preferences. The simulations show that the learning algorithm learns an effective matching policy for different generation-consumption profiles and exhibits better performance compared to standard online matching heuristics such as Match on Arrival, Match to the Highest, and Match to the Earliest Deadline policies.

eess.SY

Application of information gap decision theory in practical energy problems: A comprehensive review

The uncertainty quantification and risk modeling are hot topics in the operation and planning of energy systems. The system operators and planners are decision-makers that need to handle the uncertainty of input data of their models. As an example, energy consumption has always been a critical problem for operators since the forecasted values, and the actual consumption is never expected to be the same. The penetration of renewable energy resources is continuously increasing in recent and upcoming years. These technologies are not dispatch-able and are highly dependent on natural resources. This would make real-time energy balancing more complicated. Another source of uncertainty is related to energy market prices which are determined by the market participants behaviors. To consider these issues, uncertainty modeling should be performed. Various approaches have been previously utilized to model the uncertainty of these parameters such as probabilistic approaches, possibilistic approaches, hybrid possibilistic-probabilistic approach, information gap decision theory, robust and interval optimization techniques. This paper reviews the research works that used information gap decision theory for uncertainty modeling in energy and power systems.

eess.SY