Searcharxiv⌕ Search

arXiv subjects

Deepjyoti Deka

Publications and source records attributed to Deepjyoti Deka.

At least 55 records · Page 3Linked to original sources

Privacy-Aware Load Ensemble Control: A Linearly-Solvable MDP Approach

Demand response (DR) programs engage distributed demand-side resources, e.g., controllable residential and commercial loads, in providing ancillary services for electric power systems. Ensembles of these resources can help reducing system load peaks and meeting operational limits by adjusting their electric power consumption. To equip utilities or load aggregators with adequate decision-support tools for ensemble dispatch, we develop a Markov Decision Process (MDP) approach to optimally control load ensembles in a privacy-preserving manner. To this end, the concept of differential privacy is internalized into the MDP routine to protect transition probabilities and, thus, privacy of DR participants. The proposed approach also provides a trade-off between solution optimality and privacy guarantees, and is analyzed using real-world data from DR events in the New York University microgrid in New York, NY.

eess.SY↗

Physics-Informed Learning for High Impedance Faults Detection

High impedance faults (HIFs) in distribution grids may cause wildfires and threaten human lives. Conventional protection relays at substations fail to detect more than 10\% HIFs since over-currents are low and the signatures of HIFs are local. With more $μ$PMU being installed in the distribution system, high-resolution $μ$PMU datasets provide the opportunity of detecting HIFs from multiple points. Still, the main obstacle in applying the $μ$PMU datasets is the lack of labels. To address this issue, we construct a physics-informed convolutional auto-encoder (PICAE) to detect HIFs without labeled HIFs for training. The significance of our PICAE is a physical regularization, derived from the elliptical trajectory of voltages-current characteristics, to distinguish HIFs from other abnormal events even in highly noisy situations. We formulate a system-wide detection framework that merges multiple nodes' local detection results to improve the detection accuracy and reliability. The proposed approaches are validated in the IEEE 34-node test feeder simulated through PSCAD/EMTDC. Our PICAE outperforms the existing works in various scenarios and is robust to different observability and noise.

eess.SP↗

Guaranteed Phase & Topology Identification in Three Phase Distribution Grids

We present a method for joint phase identification and topology recovery in unbalanced three phase radial networks using only voltage measurements. By recovering phases and topology jointly, we utilize all three phase voltage measurements and can handle networks where some buses have a subset of three phases. Our method is theoretically justified by a novel linearized formulation of unbalanced three phase power flow and makes precisely defined and reasonable assumptions on line impedances and load statistics. We validate our method on three IEEE test networks simulated under realistic conditions in OpenDSS, comparing our performance to the state of the art. In addition to providing a new method for phase and topology recovery, our intuitively structured linearized model will provide a foundation for future work in this and other applications.

eess.SY↗

Topology Learning in Radial Dynamical Systems with Unreliable Data

Many complex engineering systems admit bidirectional and linear couplings between their agents. Blind and passive methods to identify such influence pathways/couplings from data are central to many applications. However, dynamically related data-streams originating at different sources are prone to corruption caused by asynchronous time-stamps of different streams, packet drops and noise. Such imperfect information may be present in the entire observation period, and hence not detected by change-detection algorithms that require an initial clean observation period. Prior work has shown that spurious links are inferred in the graph structure due to the corrupted data-streams, which prevents consistent learning. In this article, we provide a novel approach to detect the location of corrupt agents as well as present an algorithm to learn the structure of radial dynamical systems despite corrupted data streams. In particular, we show that our approach provably learns the true radial structure if the unknown corrupted nodes are at least three hops away from each other. Our theoretical results are further validated in test dynamical network.

eess.SY↗

Stochastic AC Optimal Power Flow: A Data-Driven Approach

There is an emerging need for efficient solutions to stochastic AC Optimal Power Flow ({AC-}OPF) to ensure optimal and reliable grid operations in the presence of increasing demand and generation uncertainty. This paper presents a highly scalable data-driven algorithm for stochastic AC-OPF that has extremely low sample requirement. The novelty behind the algorithm's performance involves an iterative scenario design approach that merges information regarding constraint violations in the system with data-driven sparse regression. Compared to conventional methods with random scenario sampling, our approach is able to provide feasible operating points for realistic systems with much lower sample requirements. Furthermore, multiple sub-tasks in our approach can be easily paralleled and based on historical data to enhance its performance and application. We demonstrate the computational improvements of our approach through simulations on different test cases in the IEEE PES PGLib-OPF benchmark library.

eess.SY↗

A Hierarchical Approach to Multi-Energy Demand Response: From Electricity to Multi-Energy Applications

Due to proliferation of energy efficiency measures and availability of the renewable energy resources, traditional energy infrastructure systems (electricity, heat, gas) can no longer be operated in a centralized manner under the assumption that consumer behavior is inflexible, i.e. cannot be adjusted in return for an adequate incentive. To allow for a less centralized operating paradigm, consumer-end perspective and abilities should be integrated in current dispatch practices and accounted for in switching between different energy sources not only at the system but also at the individual consumer level. Since consumers are confined within different built environments, this paper looks into an opportunity to control energy consumption of an aggregation of many residential, commercial and industrial consumers, into an ensemble. This ensemble control becomes a modern demand response contributor to the set of modeling tools for multi-energy infrastructure systems.

eess.SY↗

Tractable learning in under-excited power grids

Estimating the structure of physical flow networks such as power grids is critical to secure delivery of energy. This paper discusses statistical structure estimation in power grids in the "under-excited" regime, where a subset of internal nodes do not have external injection. Prior estimation algorithms based on nodal potentials or voltages fail in the under-excited regime. We propose a novel topology learning algorithm for learning underexcited general (non-radial) networks based on physics-informed conservation laws. We prove the asymptotic correctness of our algorithm for grids with non-adjacent under-excited internal nodes. More importantly, we theoretically analyze our algorithm's efficacy under noisy measurements, and determine bounds on maximum noise under which asymptotically correct recovery is guaranteed. Our approach is validated through simulations with non-linear voltage samples generated on test grids with real injection data

eess.SY↗

Data-Driven Learning and Load Ensemble Control

Demand response (DR) programs aim to engage distributed small-scale flexible loads, such as thermostatically controllable loads (TCLs), to provide various grid support services. Linearly Solvable Markov Decision Process (LS-MDP), a variant of the traditional MDP, is used to model aggregated TCLs. Then, a model-free reinforcement learning technique called Z-learning is applied to learn the value function and derive the optimal policy for the DR aggregator to control TCLs. The learning process is robust against uncertainty that arises from estimating the passive dynamics of the aggregated TCLs. The efficiency of this data-driven learning is demonstrated through simulations on Heating, Cooling & Ventilation (HVAC) units in a testbed neighborhood of residential houses.

eess.SY↗

Energy Storage Optimization for Grid Reliability

Large scale renewable energy integration is being planned for multiple power grids around the world. To achieve secure and stable grid operations, additional resources/reserves are needed to mitigate the inherent intermittency of renewable energy sources (RES). In this paper, we present formulations to understand the effect of fast storage reserves in improving grid reliability under different cost functions. Our formulations and solution schemes not only aim to minimize imbalance but also maintain state-of-charge (SoC) of storage. In particular, we show that accounting for system response due to inertia and local governor response enables a more realistic quantification of storage requirements for damping net load fluctuations. The storage requirement is significantly lower than values determined when such traditional response are not accounted for. We demonstrate the performance of our designed policies through studies using real data from the Elia TSO in Belgium and BPA agency in the USA. The numerical results enable us to benchmark the marginal effect on reliability due to increasing storage size under different system responses and associated cost functions.

eess.SY↗

Stochastic and Distributionally Robust Load Ensemble Control

Demand response (DR) programs aim to engage distributed demand-side resources in providing ancillary services for electric power systems. Previously, aggregated thermostatically controlled loads (TCLs) have been demonstrated as a technically viable and economically valuable provider of such services that can effectively compete with conventional generation resources in reducing load peaks and smoothing demand fluctuations. Yet, to provide these services at scale, a large number of TCLs must be accurately aggregated and operated in sync. This paper describes a Markov Decision Process (MDP) that aggregates and models an ensemble of TCLs. Using the MDP framework, we propose to internalize the exogenous uncertain dynamics of TCLs by means of stochastic and distributionally robust optimization. First, under mild assumptions on the underlying uncertainty, we derive analytical stochastic and distributionally robust control policies for dispatching a given TCL ensemble. Second, we further relax these mild assumptions to allow for a more delicate treatment of uncertainty, which leads to distributionally robust MDP formulations with moment- and Wasserstein-based ambiguity sets that can be efficiently solved numerically. The case study compares the analytical and numerical control policies using a simulated ensemble of 1,000 air conditioners.

eess.SY↗

Learning with End-Users in Distribution Grids: Topology and Parameter Estimation

Efficient operation of distribution grids in the smart-grid era is hindered by the limited presence of real-time nodal and line meters. In particular, this prevents the easy estimation of grid topology and associated line parameters that are necessary for control and optimization efforts in the grid. This paper studies the problems of topology and parameter estimation in radial balanced distribution grids where measurements are restricted to only the leaf nodes and all intermediate nodes are unobserved/hidden. To this end, we propose two exact learning algorithms that use balanced voltage and injection measured only at the end-users. The first algorithm requires time-stamped voltage samples, statistics of nodal power injections and permissible line impedances to recover the true topology. The second and improved algorithm requires only time-stamped voltage and complex power samples to recover both the true topology and impedances without any additional input (e.g., number of grid nodes, statistics of injections at hidden nodes, permissible line impedances). We prove the correctness of both learning algorithms for grids where unobserved buses/nodes have a degree greater than three and discuss extensions to regimes where that assumption doesn't hold. Further, we present computational and, more importantly, the sample complexity of our proposed algorithm for joint topology and impedance estimation. We illustrate the performance of the designed algorithms through numerical experiments on the IEEE and custom power distribution models.

eess.SY↗

Graphical Models in Meshed Distribution Grids: Topology estimation, change detection and limitations

Graphical models are a succinct way to represent the structure in probability distributions. This article analyzes the graphical model of nodal voltages in non-radial power distribution grids. Using algebraic and structural properties of graphical models, algorithms exactly determining topology and detecting line changes for distribution grids are presented along with their theoretical limitations. We show that if distribution grids have cycles/loops of size greater than three, then nodal voltages are sufficient for efficient topology estimation without additional assumptions on system parameters. In contrast, line failure or change detection using nodal voltages does not require any structural assumption. Under noisy measurements, we provide the first non-trivial bounds on the maximum noise that the system can tolerate for asymptotically correct topology recovery. The performance of the designed algorithms is validated with nonlinear AC power flow samples generated by Matpower on test grids, including scenarios with injection correlations and system noise.

eess.SY↗

Arbitrage with Power Factor Correction using Energy Storage

The importance of reactive power compensation for power factor (PF) correction will significantly increase with the large-scale integration of distributed generation interfaced via inverters producing only active power. In this work, we focus on co-optimizing energy storage for performing energy arbitrage as well as local power factor correction. The joint optimization problem is non-convex, but can be solved efficiently using a McCormick relaxation along with penalty-based schemes. Using numerical simulations on real data and realistic storage profiles, we show that energy storage can correct PF locally without reducing arbitrage profit. It is observed that active and reactive power control is largely decoupled in nature for performing arbitrage and PF correction (PFC). Furthermore, we consider a real-time implementation of the problem with uncertain load, renewable and pricing profiles. We develop a model predictive control based storage control policy using auto-regressive forecast for the uncertainty. We observe that PFC is primarily governed by the size of the converter and therefore, look-ahead in time in the online setting does not affect PFC noticeably. However, arbitrage profit are more sensitive to uncertainty for batteries with faster ramp rates compared to slow ramping batteries.

eess.SY↗

Joint Estimation of Topology and Injection Statistics in Distribution Grids with Missing Nodes

Optimal operation of distribution grid resources relies on accurate estimation of its state and topology. Practical estimation of such quantities is complicated by the limited presence of real-time meters. This paper discusses a theoretical framework to jointly estimate the operational topology and statistics of injections in radial distribution grids under limited availability of nodal voltage measurements. In particular we show that our proposed algorithms are able to provably learn the exact grid topology and injection statistics at all unobserved nodes as long as they are not adjacent. The algorithm design is based on novel ordered trends in voltage magnitude fluctuations at node groups, that are independently of interest for radial physical flow networks. The complexity of the designed algorithms is theoretically analyzed and their performance validated using both linearized and non-linear AC power flow samples in test distribution grids.

eess.SY↗

Real-time Anomaly Detection and Classification in Streaming PMU Data

Ensuring secure and reliable operations of the power grid is a primary concern of system operators. Phasor measurement units (PMUs) are rapidly being deployed in the grid to provide fast-sampled operational data that should enable quicker decision-making. This work presents a general interpretable framework for analyzing real-time PMU data, and thus enabling grid operators to understand the current state and to identify anomalies on the fly. Applying statistical learning tools on the streaming data, we first learn an effective dynamical model to describe the current behavior of the system. Next, we use the probabilistic predictions of our learned model to define in a principled way an efficient anomaly detection tool. Finally, the last module of our framework produces on-the-fly classification of the detected anomalies into common occurrence classes using features that grid operators are familiar with. We demonstrate the efficacy of our interpretable approach through extensive numerical experiments on real PMU data collected from a transmission operator in the USA.

eess.SP↗

An Adversarial Model for Attack Vector Vulnerability Analysis on Power and Gas Delivery Operations

Power systems often rely on natural gas pipeline networks to supply fuel for gas-fired generation. Market inefficiencies and a lack of formal coordination between the wholesale power and gas delivery infrastructures may magnify the broader impact of a cyber-attack on a natural gas pipeline. In this study we present a model that can be used to quantify the impact of cyber-attacks on electricity and gas delivery operations. We model activation of cyber-attack vectors that attempt to gain access to pipeline gas compressor controls using a continuous-time Markov chain over a state space based on the gas operator Industrial Control System firewall zone partition. Our approach evaluates the operating states and decision-making in the networks using physically realistic and operationally representative models. We summarize these models, the sequence of analyses used to quantify the impacts of a cyber-incident, and propose a Monte Carlo simulation approach to quantify the resulting effect on the reliability of the bulk power system by the increase in operational cost. The methodology is applied to a case study of interacting power, gas, and cyber test networks.

eess.SY↗

Designing reactive power control rules for smart inverters using support vector machines

Smart inverters have been advocated as a fast-responding mechanism for voltage regulation in distribution grids. Nevertheless, optimal inverter coordination can be computationally demanding, and preset local control rules are known to be subpar. Leveraging tools from machine learning, the design of customized inverter control rules is posed here as a multi-task learning problem. Each inverter control rule is modeled as a possibly nonlinear function of local and/or remote control inputs. Given the electric coupling, the function outputs interact to yield the feeder voltage profile. Using an approximate grid model, inverter rules are designed jointly to minimize a voltage deviation objective based on anticipated load and solar generation scenarios. Each control rule is described by a set of coefficients, one for each training scenario. To reduce the communication overhead between the grid operator and the inverters, we devise a voltage regulation objective that is shown to promote parsimonious descriptions for inverter control rules. Numerical tests using real-world data on a benchmark feeder demonstrate the advantages of the novel nonlinear rules and explore the trade-off between voltage regulation and sparsity in rule descriptions.

math.OC↗

Exact Topology Learning in a Network of Cyclostationary Processes

Learning the structure of a network from time series data, in particular cyclostationary data, is of significant interest in many disciplines such as power grids, biology and finance. In this article, an algorithm is presented for reconstruction of the topology of a network of cyclostationary processes. To the best of our knowledge, this is the first work to guarantee exact recovery without any assumptions on the underlying structure. The method is based on a lifting technique by which cyclostationary processes are mapped to vector wide sense stationary processes and further on semi-definite properties of matrix Wiener filters for the said processes.We demonstrate the performance of the proposed algorithm on a Resistor-Capacitor network and present the accuracy of reconstruction for varying sample sizes.

eess.SY↗