arXiv subjects

Dirk Witthaut

Publications and source records attributed to Dirk Witthaut.

At least 37 records · Page 2Linked to original sources

arXiv2023

Formation of trade networks by economies of scale and product differentiation

Understanding the structure and formation of networks is a central topic in complexity science. Economic networks are formed by decisions of individual agents and thus not properly described by established random graph models. In this article, we establish a model for the emergence of trade networks that is based on rational decisions of individual agents. The model incorporates key drivers for the emergence of trade, comparative advantage and economic scale effects, but also the heterogeneity of agents and the transportation or transaction costs. Numerical simulations show three macroscopically different regimes of the emerging trade networks. Depending on the specific transportation costs and the heterogeneity of individual preferences, we find centralized production with a star-like trade network, distributed production with all-to-all trading or local production and no trade. Using methods from statistical mechanics, we provide an analytic theory of the transitions between these regimes and estimates for critical parameters values.

physics.soc-ph↗

arXiv2023

Identifying drivers and mitigators for congestion and redispatch in the German electric power system with explainable AI

The transition to a sustainable energy supply challenges the operation of electric power systems in manifold ways. Transmission grid loads increase as wind and solar power are often installed far away from the consumers. In extreme cases, system operators must intervene via countertrading or redispatch to ensure grid stability. In this article, we provide a data-driven analysis of congestion in the German transmission grid. We develop an explainable machine learning model to predict the volume of redispatch and countertrade on an hourly basis. The model reveals factors that drive or mitigate grid congestion and quantifies their impact. We show that, as expected, wind power generation is the main driver, but hydropower and cross-border electricity trading also play an essential role. Solar power, on the other hand, has no mitigating effect. Our results suggest that a change to the market design would alleviate congestion.

eess.SY↗

arXiv2023

Regulatory Changes in Power Systems Explored with Explainable Artificial Intelligence

A stable supply of electrical energy is essential for the functioning of our society. Therefore, the electrical power grid's operation and energy and balancing markets are subject to strict regulations. As the external technical, economic, or social influences on the power grid change, these regulations must also be constantly adapted. However, whether these regulatory changes lead to the intended results is not easy to assess. Could eXplainable Artificial Intelligence (XAI) models distinguish regulatory settings and support the understanding of the effects of these changes? In this article, we explore two examples of regulatory changes in the German energy markets for bulk electricity and for reserve power. We explore the splitting of the German-Austrian bidding zone and changes in the pricing schemes of the German balancing energy market. We find that boosted tree models and feedforward neural networks before and after a regulatory change differ in their respective parametrizations. Using Shapley additive explanations, we reveal model differences, e.g. in terms of feature importances, and identify key features of these distinct models. With this study, we demonstrate how XAI can be applied to investigate system changes in power systems.

eess.SY↗

arXiv2023

Stability bounds of droop-controlled inverters in power grid networks

The energy mix of future power systems will include high shares of wind power and solar PV. These generation facilities are generally connected via power-electronic inverters. While conventional generation responds dynamically to the state of the electric power system, inverters are power electronic hardware and need to be programmed to react to the state of the system. Choosing an appropriate control scheme and the corresponding parameters is necessary to guarantee that the system operates safely. A prominent control scheme for inverters is droop control, which mimics the response of conventional generation. In this work, we investigate the stability of coupled systems of droop-controlled inverters in arbitrary network topologies. Employing linear stability analysis, we derive effective local stability criteria that consider both the overall network topology as well as its interplay with the inverters' intrinsic parameters. First, we explore the stability of an inverter coupled to an infinite grid in an analytic fashion and uncover stability and instability regions. Secondly, we extend the analysis to a generic topology of inverters and provide mathematical criteria for stability and instability of the system. Last, we showcase the usefulness of the criteria by examining two model systems using numerical simulations. The developed criteria show which parameters might lead to an unstable operating state.

eess.SY↗

arXiv2023

Multivariate Probabilistic Forecasting of Intraday Electricity Prices using Normalizing Flows

Electricity is traded on various markets with different time horizons and regulations. Short-term intraday trading becomes increasingly important due to the higher penetration of renewables. In Germany, the intraday electricity price typically fluctuates around the day-ahead price of the European Power EXchange (EPEX) spot markets in a distinct hourly pattern. This work proposes a probabilistic modeling approach that models the intraday price difference to the day-ahead contracts. The model captures the emerging hourly pattern by considering the four 15 min intervals in each day-ahead price interval as a four-dimensional joint probability distribution. The resulting nontrivial, multivariate price difference distribution is learned using a normalizing flow, i.e., a deep generative model that combines conditional multivariate density estimation and probabilistic regression. Furthermore, this work discusses the influence of different external impact factors based on literature insights and impact analysis using explainable artificial intelligence (XAI). The normalizing flow is compared to an informed selection of historical data and probabilistic forecasts using a Gaussian copula and a Gaussian regression model. Among the different models, the normalizing flow identifies the trends with the highest accuracy and has the narrowest prediction intervals. Both the XAI analysis and the empirical experiments highlight that the immediate history of the price difference realization and the increments of the day-ahead price have the most substantial impact on the price difference.

cs.LG↗

arXiv2023

Local versus global stability in dynamical systems with consecutive Hopf-Bifurcations

Quantifying the stability of an equilibrium is central in the theory of dynamical systems as well as in engineering and control. A comprehensive picture must include the response to both small and large perturbations, leading to the concepts of local (linear) and global stability. Here, we show how systems displaying Hopf bifurcations show contrarian results on these two aspects of stability: Global stability is large close to the point where the system loses its local stability altogether. We demonstrate this effect for an elementary model system, an anharmonic oscillator and a realistic model of power system dynamics with delayed control. Detailed investigations of the bifurcation explain the seeming paradox in terms of the location of the attractors relative to the equilibrium.

nlin.AO↗

arXiv2022

Initial analysis of the impact of the Ukrainian power grid synchronization with Continental Europe

When Russia invaded Ukraine on the 24\textsuperscript{th} of February 2022, this led to many acts of solidarity with Ukraine, including support for its electricity system. Just 20 days after the invasion started, the Ukrainian and Moldovan power grids were synchronized to the Continental European power grid to provide stability to these grids. Here, we present an initial analysis of how this synchronization affected the statistics of the power grid frequency and cross-border flows of electric power within Continental Europe. We observe faster inter-area oscillations, an increase in fluctuations and changes in the cross-border flows in and out of Ukraine and surrounding countries as an effect of the synchronization with Continental Europe. Overall these changes are small such that the now connected system can be considered as stable as before the synchronization.

physics.soc-ph↗

arXiv2022

Understanding electricity prices beyond the merit order principle using explainable AI

Electricity prices in liberalized markets are determined by the supply and demand for electric power, which are in turn driven by various external influences that vary strongly in time. In perfect competition, the merit order principle describes that dispatchable power plants enter the market in the order of their marginal costs to meet the residual load, i.e. the difference of load and renewable generation. Many market models implement this principle to predict electricity prices but typically require certain assumptions and simplifications. In this article, we present an explainable machine learning model for the prices on the German day-ahead market, which substantially outperforms a benchmark model based on the merit order principle. Our model is designed for the ex-post analysis of prices and thus builds on various external features. Using Shapley Additive exPlanation (SHAP) values, we can disentangle the role of the different features and quantify their importance from empiric data. Load, wind and solar generation are most important, as expected, but wind power appears to affect prices stronger than solar power does. Fuel prices also rank highly and show nontrivial dependencies, including strong interactions with other features revealed by a SHAP interaction analysis. Large generation ramps are correlated with high prices, again with strong feature interactions, due to the limited flexibility of nuclear and lignite plants. Our results further contribute to model development by providing quantitative insights directly from data.

cs.LG↗

arXiv2022

Physics-inspired machine learning for power grid frequency modelling

The operation of power systems is affected by diverse technical, economic and social factors. Social behaviour determines load patterns, electricity markets regulate the generation and weather-dependent renewables introduce power fluctuations. Thus, power system dynamics must be regarded as a non-autonomous system whose parameters vary strongly with time. However, the external driving factors are usually only available on coarse scales and the actual dependencies of the dynamic system parameters are generally unknown. Here, we propose a physics-inspired machine learning model that bridges the gap between large-scale drivers and short-term dynamics of the power system. Integrating stochastic differential equations and artificial neural networks, we construct a probabilistic model of the power grid frequency dynamics in Continental Europe. Its probabilistic prediction outperforms the daily average profile, which is an important benchmark. Using the integrated model, we identify and explain the parameters of the dynamical system from the data, which reveals their strong time-dependence and their relation to external drivers such as wind power feed-in and fast generation ramps. Finally, we generate synthetic time series from the model, which successfully reproduce central characteristics of the grid frequency such as their heavy-tailed distribution. All in all, our work emphasises the importance of modelling power system dynamics as a stochastic non-autonomous system with both intrinsic dynamics and external drivers.

eess.SY↗

arXiv2022

Dual communities in spatial networks

Both human-made and natural supply systems, such as power grids and leaf venation networks, are built to operate reliably under changing external conditions. Many of these spatial networks exhibit community structures. Here, we show that a relatively strong connectivity between the parts of a network can be used to define a different class of communities: dual communities. We demonstrate that traditional and dual communities emerge naturally as two different phases of optimized network structures that are shaped by fluctuations and that they suppress failure spreading, which underlines their importance in understanding the shape of real-world supply networks.

physics.soc-ph↗

arXiv2022

Predicting Dynamic Stability from Static Features in Power Grid Models using Machine Learning

A reliable supply with electric power is vital for our society. Transmission line failures are among the biggest threats for power grid stability as they may lead to a splitting of the grid into mutual asynchronous fragments. New conceptual methods are needed to assess system stability that complement existing simulation models. In this article we propose a combination of network science metrics and machine learning models to predict the risk of desynchronisation events. Network science provides metrics for essential properties of transmission lines such as their redundancy or centrality. Machine learning models perform inherent feature selection and thus reveal key factors that determine network robustness and vulnerability. As a case study, we train and test such models on simulated data from several synthetic test grids. We find that the integrated models are capable of predicting desynchronisation events after line failures with an average precision greater than $0.996$ when averaging over all data sets. Learning transfer between different data sets is generally possible, at a slight loss of prediction performance. Our results suggest that power grid desynchronisation is essentially governed by only a few network metrics that quantify the networks ability to reroute flow without creating exceedingly high static line loadings.

eess.SY↗

arXiv2022

Understanding Braess' Paradox in power grids

The ongoing energy transition requires power grid extensions to connect renewable generators to consumers and to transfer power among distant areas. The process of grid extension requires a large investment of resources and is supposed to make grid operation more robust. Yet, counter-intuitively, increasing the capacity of existing lines or adding new lines may also reduce the overall system performance and even promote blackouts due to Braess' paradox. Braess' paradox was theoretically modeled but not yet proven in realistically scaled power grids. Here, we present an experimental setup demonstrating Braess' paradox in an AC power grid and show how it constrains ongoing large-scale grid extension projects. We present a topological theory that reveals the key mechanism and predicts Braessian grid extensions from the network structure. These results offer a theoretical method to understand and practical guidelines in support of preventing unsuitable infrastructures and the systemic planning of grid extensions.

eess.SY↗

arXiv2022

Predicting Braess' Paradox in Supply and Transport Networks

Reliable functioning of supply and transport networks fundamentally support many non-equilibrium dynamical systems, from biological organisms and ecosystems to human-made water, gas, heat, electricity and traffic networks. Strengthening an edge of such a network lowers its resistance opposing a flow and intuitively improves the robustness of the system's function. If, in contrast, it deteriorate operation by overloading other edges, the counterintuitive phenomenon of \emph{Braess' paradox} emerges. How to predict which edges enhancements may trigger Braess' paradox remains unknown to date. To approximately locate and intuitively understand such Braessian edges, we here present a differential perspective on how enhancing any edge impacts network-wide flow patterns. First, we exactly map the prediction problem to a dual problem of electrostatic dipole currents on networks such that simultaneously finding \textit{all} Braessian edges is equivalent to finding the currents in the resistor network resulting from a constant current across one edge. Second, we propose a simple approximate criterion -- rerouting alignment -- to efficiently predict Braessian edges, thereby providing an intuitive topological understanding of the phenomenon. Finally, we show how to intentionally weaken Braessian edges to mitigate network overload, with beneficial consequences for network functionality.

nlin.AO↗

arXiv2022

Revealing interactions between HVDC cross-area flows and frequency stability with explainable AI

The energy transition introduces more volatile energy sources into the power grids. In this context, power transfer between different synchronous areas through High Voltage Direct Current (HVDC) links becomes increasingly important. Such links can balance volatile generation by enabling long-distance transport or by leveraging their fast control behavior. Here, we investigate the interaction of power imbalances - represented through the power grid frequency - and power flows on HVDC links between synchronous areas in Europe. We use explainable machine learning to identify key dependencies and disentangle the interaction of critical features. Our results show that market-based HVDC flows introduce deterministic frequency deviations, which however can be mitigated through strict ramping limits. Moreover, varying HVDC operation modes strongly affect the interaction with the grid. In particular, we show that load-frequency control via HVDC links can both have control-like or disturbance-like impacts on frequency stability.

eess.SY↗

arXiv2022

Collective effects and synchronization of demand in real-time demand response

Sustainable energy systems require flexible elements to balance the variability of renewable energy sources. Demand response aims to adapt the demand to the variable generation, in particular by shifting the load in time. In this article, we provide a detailed statistic analysis of the collective operation of many demand response units. We establish and simulate a model for load shifting in response to real-time electricity pricing using local storage systems. We show that demand response drives load shifting as desired, but also induces strong collective effects that may threaten system stability. The load of individual households synchronizes, leading to extreme demand peaks. We provide a detailed statistical analysis of the grid load, and quantify both the likeliness and extent of extreme demand peaks.

physics.soc-ph↗

arXiv2022

Revealing drivers and risks for power grid frequency stability with explainable AI

Stable operation of the electrical power system requires the power grid frequency to stay within strict operational limits. With millions of consumers and thousands of generators connected to a power grid, detailed human-build models can no longer capture the full dynamics of this complex system. Modern machine learning algorithms provide a powerful alternative for system modelling and prediction, but the intrinsic black-box character of many models impedes scientific insights and poses severe security risks. Here, we show how eXplainable AI (XAI) alleviates these problems by revealing critical dependencies and influences on the power grid frequency. We accurately predict frequency stability indicators (such as RoCoF and Nadir) for three major European synchronous areas and identify key features that determine the power grid stability. Load ramps, specific generation ramps but also prices and forecast errors are central to understand and stabilize the power grid.

eess.SY↗

arXiv2021

Validation Methods for Energy Time Series Scenarios from Deep Generative Models

The design and operation of modern energy systems are heavily influenced by time-dependent and uncertain parameters, e.g., renewable electricity generation, load-demand, and electricity prices. These are typically represented by a set of discrete realizations known as scenarios. A popular scenario generation approach uses deep generative models (DGM) that allow scenario generation without prior assumptions about the data distribution. However, the validation of generated scenarios is difficult, and a comprehensive discussion about appropriate validation methods is currently lacking. To start this discussion, we provide a critical assessment of the currently used validation methods in the energy scenario generation literature. In particular, we assess validation methods based on probability density, auto-correlation, and power spectral density. Furthermore, we propose using the multifractal detrended fluctuation analysis (MFDFA) as an additional validation method for non-trivial features like peaks, bursts, and plateaus. As representative examples, we train generative adversarial networks (GANs), Wasserstein GANs (WGANs), and variational autoencoders (VAEs) on two renewable power generation time series (photovoltaic and wind from Germany in 2013 to 2015) and an intra-day electricity price time series form the European Energy Exchange in 2017 to 2019. We apply the four validation methods to both the historical and the generated data and discuss the interpretation of validation results as well as common mistakes, pitfalls, and limitations of the validation methods. Our assessment shows that no single method sufficiently characterizes a scenario but ideally validation should include multiple methods and be interpreted carefully in the context of scenarios over short time periods.

cs.LG↗

arXiv2021

Change of persistence in European electricity spot prices

The European Power Exchange has introduced day-ahead auctions and continuous trading spot markets to facilitate the insertion of renewable electricity. These markets are designed to balance excess or lack of power in short time periods, which leads to a large stochastic variability of the electricity prices. Furthermore, the different markets show different stochastic memory in their electricity price time series, which seem to be the cause for the large volatility. In particular, we show the antithetical temporal correlation in the intraday 15 minutes spot markets in comparison to the day-ahead hourly market. We contrast the results from Detrended Fluctuation Analysis (DFA) to a new method based on the Kramers--Moyal equation in scale. For very short term ($<12$ hours), all price time series show positive temporal correlations (Hurst exponent $H>0.5$) except for the intraday 15 minute market, which shows strong negative correlations ($H<0.5$). For longer term periods covering up to two days, all price time series are anti-correlated ($H<0.5$).

q-fin.ST↗