arXiv subjects

Krishnamurthy Dvijotham

Publications and source records attributed to Krishnamurthy Dvijotham.

59 records · Page 4Linked to original sources

arXiv2013

Convex Structured Controller Design

We consider the problem of synthesizing optimal linear feedback policies subject to arbitrary convex constraints on the feedback matrix. This is known to be a hard problem in the usual formulations ($\Htwo,\Hinf,\LQR$) and previous works have focused on characterizing classes of structural constraints that allow efficient solution through convex optimization or dynamic programming techniques. In this paper, we propose a new control objective and show that this formulation makes the problem of computing optimal linear feedback matrices convex under arbitrary convex constraints on the feedback matrix. This allows us to solve problems in decentralized control (sparsity in the feedback matrices), control with delays and variable impedance control. Although the control objective is nonstandard, we present theoretical and empirical evidence that it agrees well with standard notions of control. We also present an extension to nonlinear control affine systems. We present numerical experiments validating our approach.

eess.SY↗

arXiv2013

Storage Sizing and Placement through Operational and Uncertainty-Aware Simulations

As the penetration level of transmission-scale time-intermittent renewable generation resources increases, control of flexible resources will become important to mitigating the fluctuations due to these new renewable resources. Flexible resources may include new or existing synchronous generators as well as new energy storage devices. Optimal placement and sizing of energy storage to minimize costs of integrating renewable resources is a difficult optimization problem. Further,optimal planning procedures typically do not consider the effect of the time dependence of operations and may lead to unsatisfactory results. Here, we use an optimal energy storage control algorithm to develop a heuristic procedure for energy storage placement and sizing. We perform operational simulation under various time profiles of intermittent generation, loads and interchanges (artificially generated or from historical data) and accumulate statistics of the usage of storage at each node under the optimal dispatch. We develop a greedy heuristic based on the accumulated statistics to obtain a minimal set of nodes for storage placement. The quality of the heuristic is explored by comparing our results to the obvious heuristic of placing storage at the renewables for IEEE benchmarks and real-world network topologies.

math.OC↗

arXiv2012

Distributed Control of Generation in a Transmission Grid with a High Penetration of Renewables

Deviations of grid frequency from the nominal frequency are an indicator of the global imbalance between genera- tion and load. Two types of control, a distributed propor- tional control and a centralized integral control, are cur- rently used to keep frequency deviations small. Although generation-load imbalance can be very localized, both controls primarily rely on frequency deviation as their in- put. The time scales of control require the outputs of the centralized integral control to be communicated to distant generators every few seconds. We reconsider this con- trol/communication architecture and suggest a hybrid ap- proach that utilizes parameterized feedback policies that can be implemented in a fully distributed manner because the inputs to these policies are local observables at each generator. Using an ensemble of forecasts of load and time-intermittent generation representative of possible fu- ture scenarios, we perform a centralized off-line stochas- tic optimization to select the generator-specific feedback parameters. These parameters need only be communi- cated to generators once per control period (60 minutes in our simulations). We show that inclusion of local power flows as feedback inputs is crucial and reduces frequency deviations by a factor of ten. We demonstrate our con- trol on a detailed transmission model of the Bonneville Power Administration (BPA). Our findings suggest that a smart automatic and distributed control, relying on ad- vanced off-line and system-wide computations commu- nicated to controlled generators infrequently, may be a viable control and communication architecture solution. This architecture is suitable for a future situation when generation-load imbalances are expected to grow because of increased penetration of time-intermittent generation.

eess.SY↗

arXiv2012

A Unifying Framework for Linearly Solvable Control

Recent work has led to the development of an elegant theory of Linearly Solvable Markov Decision Processes (LMDPs) and related Path-Integral Control Problems. Traditionally, MDPs have been formulated using stochastic policies and a control cost based on the KL divergence. In this paper, we extend this framework to a more general class of divergences: the Renyi divergences. These are a more general class of divergences parameterized by a continuous parameter that include the KL divergence as a special case. The resulting control problems can be interpreted as solving a risk-sensitive version of the LMDP problem. For a > 0, we get risk-averse behavior (the degree of risk-aversion increases with a) and for a < 0, we get risk-seeking behavior. We recover LMDPs in the limit as a -> 0. This work generalizes the recently developed risk-sensitive path-integral control formalism which can be seen as the continuous-time limit of results obtained in this paper. To the best of our knowledge, this is a general theory of linearly solvable control and includes all previous work as a special case. We also present an alternative interpretation of these results as solving a 2-player (cooperative or competitive) Markov Game. From the linearity follow a number of nice properties including compositionality of control laws and a path-integral representation of the value function. We demonstrate the usefulness of the framework on control problems with noise where different values of lead to qualitatively different control behaviors.

eess.SY↗

arXiv2011

Operations-Based Planning for Placement and Sizing of Energy Storage in a Grid With a High Penetration of Renewables

As the penetration level of transmission-scale time-intermittent renewable generation resources increases, control of flexible resources will become important to mitigating the fluctuations due to these new renewable resources. Flexible resources may include new or existing synchronous generators as well as new energy storage devices. The addition of energy storage, if needed, should be done optimally to minimize the integration cost of renewable resources, however, optimal placement and sizing of energy storage is a difficult optimization problem. The fidelity of such results may be questionable because optimal planning procedures typically do not consider the effect of the time dynamics of operations and controls. Here, we use an optimal energy storage control algorithm to develop a heuristic procedure for energy storage placement and sizing. We generate many instances of intermittent generation time profiles and allow the control algorithm access to unlimited amounts of storage, both energy and power, at all nodes. Based on the activity of the storage at each node, we restrict the number of storage node in a staged procedure seeking the minimum number of storage nodes and total network storage that can still mitigate the effects of renewable fluctuations on network constraints. The quality of the heuristic is explored by comparing our results to seemingly "intuitive" placements of storage.

math.OC↗