Searcharxiv⌕ Search

arXiv subjects

Andreas Ulbig

Publications and source records attributed to Andreas Ulbig.

At least 37 records · Page 2Linked to original sources

AI-based Attacker Models for Enhancing Multi-Stage Cyberattack Simulations in Smart Grids Using Co-Simulation Environments

The transition to smart grids has increased the vulnerability of electrical power systems to advanced cyber threats. To safeguard these systems, comprehensive security measures-including preventive, detective, and reactive strategies-are necessary. As part of the critical infrastructure, securing these systems is a major research focus, particularly against cyberattacks. Many methods are developed to detect anomalies and intrusions and assess the damage potential of attacks. However, these methods require large amounts of data, which are often limited or private due to security concerns. We propose a co-simulation framework that employs an autonomous agent to execute modular cyberattacks within a configurable environment, enabling reproducible and adaptable data generation. The impact of virtual attacks is compared to those in a physical lab targeting real smart grids. We also investigate the use of large language models for automating attack generation, though current models on consumer hardware are unreliable. Our approach offers a flexible, versatile source for data generation, aiding in faster prototyping and reducing development resources and time.

cs.CR↗

Digital Twin for Evaluating Detective Countermeasures in Smart Grid Cybersecurity

As the integration of digital technologies and communication systems continues within distribution grids, new avenues emerge to tackle energy transition challenges. Nevertheless, this deeper technological immersion amplifies the necessity for resilience against threats, encompassing both systemic outages and targeted cyberattacks. To ensure the robustness and safeguarding of vital infrastructure, a thorough examination of potential smart grid vulnerabilities and subsequent countermeasure development is essential. This study delves into the potential of digital twins, replicating a smart grid's cyber-physical laboratory environment, thereby enabling focused cybersecurity assessments. Merging the nuances of communication network emulation and power network simulation, we introduce a flexible, comprehensive digital twin model equipped for hardware-in-the-loop evaluations. Through this innovative framework, we not only verify and refine security countermeasures but also underscore their role in maintaining grid stability and trustworthiness.

cs.CR↗

Towards more realistic co-simulation of cyber-physical energy distribution systems

The increased integration of information and communications technology at the distribution grid level offers broader opportunities for active operational management concepts. At the same time, requirements for resilience against internal and external threats to the power supply, such as outages or cyberattacks, are increasing. The emerging threat landscape needs to be investigated to ensure the security of supply of future distribution grids. This extended abstract presents a co-simulation environment to study communication infrastructures for the resilient operation of distribution grids. For this purpose, a communication network emulation and a power grid simulation are combined in a common modular environment. This will provide the basis for cybersecurity investigations and testing of new active operation management concepts for smart grids. Exemplary laboratory tests and attack replications will be used to demonstrate the diverse use cases of our co-simulation approach.

eess.SY↗

An AI-based, Error-bounded Compression Scheme for High-frequency Power Quality Disturbance Data

The implementation of modern monitoring systems for power quality disturbances have the potential to generate substantial amounts of data, reaching a point where transmission and storage of high-frequency measurements become impractical. This research paper addresses this challenge by presenting a new, AI-based data compression method. It is based on existing, multi-level compression schemes; however, it uses state-of-the-art technologies, such as autoencoders, to improve the performance. Furthermore, it solves the problem that such algorithms usually cannot ensure an error bound. The scheme is tested on synthetically generated power quality disturbance samples. The evaluation is performed using different metrics such as final compression rate and overhead size. Compression rates between 5 and 68 were achieved depending on the error bound and noise level. Additionally, the impact of the compression on the performance of subsequent algorithms is determined by applying a classification algorithm to the decompressed data. The classification accuracy only declined by 0.8--11.9 \%, depending on the chosen error bound.

eess.SY↗

End-to-End Reinforcement Learning of Curative Curtailment with Partial Measurement Availability

In the course of the energy transition, the expansion of generation and consumption will change, and many of these technologies, such as PV systems, electric cars and heat pumps, will influence the power flow, especially in the distribution grids. Scalable methods that can make decisions for each grid connection are needed to enable congestion-free grid operation in the distribution grids. This paper presents a novel end-to-end approach to resolving congestion in distribution grids with deep reinforcement learning. Our architecture learns to curtail power and set appropriate reactive power to determine a non-congested and, thus, feasible grid state. State-of-the-art methods such as the optimal power flow (OPF) demand high computational costs and detailed measurements of every bus in a grid. In contrast, the presented method enables decisions under sparse information with just some buses observable in the grid. Distribution grids are generally not yet fully digitized and observable, so this method can be used for decision-making on the majority of low-voltage grids. On a real low-voltage grid the approach resolves 100\% of violations in the voltage band and 98.8\% of asset overloads. The results show that decisions can also be made on real grids that guarantee sufficient quality for congestion-free grid operation.

cs.LG↗

Analysing the interaction of expansion decisions by end customers and grid development in the context of a municipal energy system

In order to achieve greenhouse gas neutrality by 2045, the Climate Protection Act sets emission reduction targets for the years 2030 and 2040, as well as decreasing annual emission volumes for some sectors, including the building sector. Measures to decarbonize the building sector include energy retrofits and the expansion of renewable, decentralized power generators and low-CO2 heat generators. These measures thus change both the load and the generation of the future energy supply concept. Considering the interactions of the changed installed technologies on the building level and their influence on the electrical grid infrastructure is necessary. The grid operator will remedy the future congested grid states by grid expansion measures and pass on the costs to the connected grid users, which in turn could influence their behaviour and decisions. The aim of this work is a holistic analysis of the staggered interactions of generation expansion and grid expansion for a future decentralized energy supply concept conditioned by the expansion in the field of self-generation. To enable the analysis of the interactions, a multi-criteria optimization procedure for expansion and operation decisions at the building level is combined with an approach to determine grid expansion. As part of this work, the effect of an expansion of hosting capacity on the grid charges and thus the decision-making behaviour was investigated.

eess.SY↗

Hierarchical Provision of Distribution Grid Flexibility with Online Feedback Optimization

Utilizing distribution grid flexibility for ancillary services requires the coordination and dispatch of requested active and reactive power to a large number of distributed energy resources in underlying grid layers. This paper presents an approach to hierarchically dispatch flexibility requests based on Online Feedback Optimization (OFO). We implement a framework of individual controllers coordinating actors, contributing to flexibility provision, to track a requested operating point at the interface between grid layers. The framework is evaluated in terms of performance during coordination and possible interaction between individual controllers, both central and distributed. Results show high reliability and robustness of the OFO controllers as well as an efficient dispatch of active and reactive power. Its computational efficiency and capabilities in set point tracking during online grid operation are making OFO a promising approach to the flexibility dispatch problem.

eess.SY↗

Tuning and Testing an Online Feedback Optimization Controller to Provide Curative Distribution Grid Flexibility

Due to more volatile generation, flexibility will become more important in transmission grids. One potential source of this flexibility can be distribution grids. A flexibility request from the transmission grid to a distribution grid then needs to be split up onto the different flexibility providing units (FPU) in the distribution grid. One potential way to do this is Online Feedback Optimization (OFO). OFO is a new control method that steers power systems to the optimal solution of an optimization problem using minimal model information and computation power. This paper will show how to choose the optimization problem and how to tune the OFO controller. Afterward, we test the resulting controller on a real distribution grid laboratory and show its performance, its interaction with other controllers in the grid, and how it copes with disturbances. Overall, the paper makes a clear recommendation on how to phrase the optimization problem and tune the OFO controller. Furthermore, it experimentally verifies that an OFO controller is a powerful tool to disaggregate flexibility requests onto FPUs while satisfying operational constraints inside the flexibility providing distribution grid.

eess.SY↗

Enhancing SCADA Security: Developing a Host-Based Intrusion Detection System to Safeguard Against Cyberattacks

With the increasing reliance of smart grids on correctly functioning SCADA systems and their vulnerability to cyberattacks, there is a pressing need for effective security measures. SCADA systems are prone to cyberattacks, posing risks to critical infrastructure. As there is a lack of host-based intrusion detection systems specifically designed for the stable nature of SCADA systems, the objective of this work is to propose a host-based intrusion detection system tailored for SCADA systems in smart grids. The proposed system utilizes USB device identification, flagging, and process memory scanning to monitor and detect anomalies in SCADA systems, providing enhanced security measures. Evaluation in three different scenarios demonstrates the tool's effectiveness in detecting and disabling malware. The proposed approach effectively identifies potential threats and enhances the security of SCADA systems in smart grids, providing a promising solution to protect against cyberattacks.

cs.CR↗

Benchmark Evaluation of Anomaly-Based Intrusion Detection Systems in the Context of Smart Grids

The increasing digitization of smart grids has made addressing cybersecurity issues crucial in order to secure the power supply. Anomaly detection has emerged as a key technology for cybersecurity in smart grids, enabling the detection of unknown threats. Many research efforts have proposed various machine-learning-based approaches for anomaly detection in grid operations. However, there is a need for a reproducible and comprehensive evaluation environment to investigate and compare different approaches to anomaly detection. The assessment process is highly dependent on the specific application and requires an evaluation that considers representative datasets from the use case as well as the specific characteristics of the use case. In this work, we present an evaluation environment for anomaly detection methods in smart grids that facilitates reproducible and comprehensive evaluation of different anomaly detection methods.

cs.CR↗

An Approach to Abstract Multi-stage Cyberattack Data Generation for ML-Based IDS in Smart Grids

Power grids are becoming more digitized, resulting in new opportunities for the grid operation but also new challenges, such as new threats from the cyber-domain. To address these challenges, cybersecurity solutions are being considered in the form of preventive, detective, and reactive measures. Machine learning-based intrusion detection systems are used as part of detection efforts to detect and defend against cyberattacks. However, training and testing data for these systems are often not available or suitable for use in machine learning models for detecting multi-stage cyberattacks in smart grids. In this paper, we propose a method to generate synthetic data using a graph-based approach for training machine learning models in smart grids. We use an abstract form of multi-stage cyberattacks defined via graph formulations and simulate the propagation behavior of attacks in the network. Within the selected scenarios, we observed promising results, but a larger number of scenarios need to be studied to draw a more informed conclusion about the suitability of synthesized data.

cs.CR↗

Investigation of Multi-stage Attack and Defense Simulation for Data Synthesis

The power grid is a critical infrastructure that plays a vital role in modern society. Its availability is of utmost importance, as a loss can endanger human lives. However, with the increasing digitalization of the power grid, it also becomes vulnerable to new cyberattacks that can compromise its availability. To counter these threats, intrusion detection systems are developed and deployed to detect cyberattacks targeting the power grid. Among intrusion detection systems, anomaly detection models based on machine learning have shown potential in detecting unknown attack vectors. However, the scarcity of data for training these models remains a challenge due to confidentiality concerns. To overcome this challenge, this study proposes a model for generating synthetic data of multi-stage cyber attacks in the power grid, using attack trees to model the attacker's sequence of steps and a game-theoretic approach to incorporate the defender's actions. This model aims to create diverse attack data on which machine learning algorithms can be trained.

cs.CR↗

Multi-stage optimisation towards transformation pathways for municipal energy systems

An essential facet of achieving climate neutrality by 2045 is the decarbonization of municipal energy systems. To accomplish this, it is necessary to establish implementation concepts that detail the timing, location, and specific measures required to achieve decarbonization. This restructuring process involves identifying the measures that offer the most compelling techno-economic and ecological advantages. In particular, measures that contribute to the interconnection of energy vectors and domains, e.g. heating, cooling, and electricity supply, in the sense of decentralized multi-energy systems are a promising future development option. Due to the high complexity resulting from a multitude of decision options as well as a temporal coupling across the transformation path, the use of optimization methods is required, which enable a bottom-up identification of suitable transformation solutions in a high spatial resolution. For the design of reasonable concepts, we develop a multistage optimization problem for the derivation of transformation pathways in the context of a multi-location structure, expansion, and operation problem. The results show that the heat supply in the future will mainly be provided by heat pumps with a share of 60%. It can also be shown that an early dismantling of the gas network will lead to the need for transitional technologies such as pellet heating. Overall, the conversion of the municipal energy system can significantly reduce emissions (97%).

eess.SY↗

Providing Curative Distribution Grid Flexibility Using Online Feedback Optimization

Distribution grid flexibility is discussed as a possible measure in curative system operation, yielding a need for an efficient and robust coordination mechanism for the joint flexibility provision by individual units to the transmission grid. This paper introduces a method to coordinate distribution grid level flexibility as a fast-responding curative measure based on Online Feedback Optimization. We utilize an optimization algorithm in a closed loop with the distribution grid to dispatch set points for active and reactive power to flexibility providing units. The approach is evaluated in an experimental setup, utilizing assets connected to an exemplary low voltage grid. Online Feedback Optimization is found to be both a viable as well as a highly effective approach to coordinate distributed energy resources in real-time curative system operation.

eess.SY↗

Representation of Distribution Grid Expansion Costs in Power System Planning

The shift towards clean energy brings about notable transformations to the energy system. In order to optimally plan a future energy system, it is necessary to consider the influence of several sectors as well as the interaction of the transmission grid and distribution grid. The concept of Feasible Operation Region (FOR) is a detailed approach to representing the operational dependencies between the transmission and distribution grid. However, in previous planning procedures, only a simplified expansion of the distribution grids can be taken into account. With the method presented in this paper, a Feasible Planning Region (FPR) is developed, which represents the operational boundaries of the distribution grids for several expansion stages and thus represents an admissible solution space for the planning of distribution grids in systemic planning approaches. It hence enables a more detailed representation of the necessary distribution grid expansion for the integration of distributed technologies in an optimized energy system of the future. In this paper, we present the method by which the FPR is formed and its integration into an energy system planning formulation. In the results, the FPR is presented for different voltage levels, and its use in power system planning is demonstrated.

eess.SY↗

Solving AC Power Flow with Graph Neural Networks under Realistic Constraints

In this paper, we propose a graph neural network architecture to solve the AC power flow problem under realistic constraints. To ensure a safe and resilient operation of distribution grids, AC power flow calculations are the means of choice to determine grid operating limits or analyze grid asset utilization in planning procedures. In our approach, we demonstrate the development of a framework that uses graph neural networks to learn the physical constraints of the power flow. We present our model architecture on which we perform unsupervised training to learn a general solution of the AC power flow formulation independent of the specific topologies and supply tasks used for training. Finally, we demonstrate, validate and discuss our results on medium voltage benchmark grids. In our approach, we focus on the physical and topological properties of distribution grids to provide scalable solutions for real grid topologies. Therefore, we take a data-driven approach, using large and diverse data sets consisting of realistic grid topologies, for the unsupervised training of the AC power flow graph neural network architecture and compare the results to a prior neural architecture and the Newton-Raphson method. Our approach shows a high increase in computation time and good accuracy compared to state-of-the-art solvers. It also out-performs that neural solver for power flow in terms of accuracy.

cs.LG↗

On the Impact of Smartification Strategies for the State Estimation of Low Voltage Grids

The decarbonization of for example the energy or heat sector leads to the transformation of distribution grids. The expansion of decentralized energy resources and the integration of new consumers due to sector coupling (e.g. heat pumps or electric vehicles) into low voltage grids increases the need for grid expansion and usage of flexibilities in the grid. A high observability of the current grid status is needed to perform these tasks efficiently and effectively. Therefore, there is a need to increase the observability of low voltage grids by installing measurement technologies (e.g. smart meters). Multiple different measurement technologies are available for low voltage grids which can vary in their benefit to observation quality and their installation costs. Therefore, Bayernwerk Netz GmbH and E.DIS AG in cooperation with E-Bridge Consulting GmbH and the Institute for High Voltage Equipment and Grids, Digitalization and Energy Economics (IAEW) investigated the effectiveness of different strategies for the smartification of low voltage grids. This paper presents the methodology used for the investigation and exemplary results focusing on the impact of intelligent cable distribution cabinets and smart meters on the quality of the state estimation.

eess.SY↗

On Holistic Multi-Step Cyberattack Detection via a Graph-based Correlation Approach

While digitization of distribution grids through information and communications technology brings numerous benefits, it also increases the grid's vulnerability to serious cyber attacks. Unlike conventional systems, attacks on many industrial control systems such as power grids often occur in multiple stages, with the attacker taking several steps at once to achieve its goal. Detection mechanisms with situational awareness are needed to detect orchestrated attack steps as part of a coherent attack campaign. To provide a foundation for detection and prevention of such attacks, this paper addresses the detection of multi-stage cyber attacks with the aid of a graph-based cyber intelligence database and alert correlation approach. Specifically, we propose an approach to detect multi-stage attacks by leveraging heterogeneous data to form a knowledge base and employ a model-based correlation approach on the generated alerts to identify multi-stage cyber attack sequences taking place in the network. We investigate the detection quality of the proposed approach by using a case study of a multi-stage cyber attack campaign in a future-orientated power grid pilot.

cs.CR↗