Searcharxiv⌕ Search

arXiv subjects

Sören Hohmann

Publications and source records attributed to Sören Hohmann.

65 records · Page 4Linked to original sources

Multi-Robot Task Allocation and Scheduling Considering Cooperative Tasks and Precedence Constraints

In order to fully exploit the advantages inherent to cooperating heterogeneous multi-robot teams, sophisticated coordination algorithms are essential. Time-extended multi-robot task allocation approaches assign and schedule a set of tasks to a group of robots such that certain objectives are optimized and operational constraints are met. This is particularly challenging if cooperative tasks, i.e. tasks that require two or more robots to work directly together, are considered. In this paper, we present an easy-to-implement criterion to validate the feasibility, i.e. executability, of solutions to time-extended multi-robot task allocation problems with cross schedule dependencies arising from the consideration of cooperative tasks and precedence constraints. Using the introduced feasibility criterion, we propose a local improvement heuristic based on a neighborhood operator for the problem class under consideration. The initial solution is obtained by a greedy constructive heuristic. Both methods use a generalized cost structure and are therefore able to handle various objective function instances. We evaluate the proposed approach using test scenarios of different problem sizes, all comprising the complexity aspects of the regarded problem. The simulation results illustrate the improvement potential arising from the application of the local improvement heuristic.

eess.SY↗

Partner Approximating Learners (PAL): Simulation-Accelerated Learning with Explicit Partner Modeling in Multi-Agent Domains

Mixed cooperative-competitive control scenarios such as human-machine interaction with individual goals of the interacting partners are very challenging for reinforcement learning agents. In order to contribute towards intuitive human-machine collaboration, we focus on problems in the continuous state and control domain where no explicit communication is considered and the agents do not know the others' goals or control laws but only sense their control inputs retrospectively. Our proposed framework combines a learned partner model based on online data with a reinforcement learning agent that is trained in a simulated environment including the partner model. Thus, we overcome drawbacks of independent learners and, in addition, benefit from a reduced amount of real world data required for reinforcement learning which is vital in the human-machine context. We finally analyze an example that demonstrates the merits of our proposed framework which learns fast due to the simulated environment and adapts to the continuously changing partner due to the partner approximation.

eess.SY↗

Adaptive Dynamic Programming for Model-free Tracking of Trajectories with Time-varying Parameters

In order to autonomously learn to control unknown systems optimally w.r.t. an objective function, Adaptive Dynamic Programming (ADP) is well-suited to adapt controllers based on experience from interaction with the system. In recent years, many researchers focused on the tracking case, where the aim is to follow a desired trajectory. So far, ADP tracking controllers assume that the reference trajectory follows time-invariant exo-system dynamics-an assumption that does not hold for many applications. In order to overcome this limitation, we propose a new Q-function which explicitly incorporates a parametrized approximation of the reference trajectory. This allows to learn to track a general class of trajectories by means of ADP. Once our Q-function has been learned, the associated controller copes with time-varying reference trajectories without need of further training and independent of exo-system dynamics. After proposing our general model-free off-policy tracking method, we provide analysis of the important special case of linear quadratic tracking. We conclude our paper with an example which demonstrates that our new method successfully learns the optimal tracking controller and outperforms existing approaches in terms of tracking error and cost.

eess.SY↗

A Scalable Port-Hamiltonian Approach to Plug-and-Play Voltage Stabilization in DC Microgrids

One of the major challenges of voltage stabilization in converter-based DC microgrids are the multiple interacting units displaying intermittent supply behavior. In this paper, we address this by a decentralized scalable, plug-and-play voltage controller for voltage-source converters (VSCs) at primary level. In contrast to existing approaches, we follow a systematic and constructive design based on port-Hamiltonian systems (PHSs) which does neither require the heuristic proposition of a Lyapunov function nor the computation of auxilliary variables such as time-derivatives. By employing the Hamiltonian naturally obtained from the PHS approach as Lyapunov function and using the modularity of passive systems, we provide sufficient conditions under which the designed VSC controllers achieve microgrid-wide asymptotic voltage stability. Integral action (IA), which preserves the passive PHS structure, robustifies the design against unknown disturbances and ensures zero voltage errors in the steady-state. Numerical simulations illustrate the functionality of the proposed voltage controller.

eess.SY↗

Passivity Conditions for Plug-and-Play Operation of Nonlinear Static AC Loads

The complexity arising in AC microgrids from multiple interacting distributed generation units (DGUs) with intermittent supply behavior requires local voltage-source inverters (VSIs) to be controlled in a distributed or decentralized manner at primary level. In (Strehle et al., 2019), we use passivity theory to design decentralized, plug-and-play voltage and frequency controllers for such VSIs. However, the stability analysis of the closed-loop system requires a load-connected topology, in contrast to real grids where loads are arbitrarily located. In this paper, we expand our former approach by considering the more realistic and general case of nonlinear static AC loads (ZIP and exponential) at arbitrary locations within an AC microgrid. Investigating the monotonicity of differentiable mappings, we derive sufficient inequality conditions for the strict passivity of these nonlinear static AC loads. Together with our plug-and-play VSI controller, this allows us to use passivity arguments to infer asymptotic voltage and frequency stability for AC microgrids with arbitrary topologies. An illustrative simulation validating our theoretical findings concludes our work.

eess.SY↗

Distributed Frequency and Voltage Control for AC Microgrids based on Primal-Dual Gradient Dynamics

With the gradual transformation of power generation towards renewables, distributed energy resources are becoming more and more relevant for grid stabilization. In order to involve all participants in the joint solution of this challenging task, we propose a distributed, model-based and unifying controller for frequency and voltage regulation in AC microgrids, based on steady-state optimal control. It not only unifies frequency and voltage control, but also incorporates the classic hierarchy of primary, secondary and tertiary control layers with each closed-loop equilibrium being a minimizer of a user-defined cost function. By considering the individual voltage limits as additional constraints in the corresponding optimization problem, no superordinate specification of voltage setpoints is required. Since the dynamic model of the microgrid has a port-Hamiltonian structure, stability of the overall system can be assessed using shifted passivity properties. Furthermore, we demonstrate the effectiveness of the controller and its robustness against fluctuations in active and reactive power demand by means of numerical examples.

math.OC↗

Adaptive Optimal Control for Reference Tracking Independent of Exo-System Dynamics

Model-free control based on the idea of Reinforcement Learning is a promising approach that has recently gained extensive attention. However, Reinforcement-Learning-based control methods solely focus on the regulation problem or learn to track a reference that is generated by a time-invariant exo-system. In the latter case, controllers are only able to track the time-invariant reference dynamics which they have been trained on and need to be re-trained each time the reference dynamics change. Consequently, these methods fail in a number of applications which obviously rely on a trajectory not being generated by an exo-system. One prominent example is autonomous driving. This paper provides for the first time an adaptive optimal control method capable to track reference trajectories not being generated by a time-invariant exo-system. The main innovation is a novel Q-function that directly incorporates a given reference trajectory on a moving horizon. This new Q-function exhibits a particular structure which allows the design of an efficient, iterative, provably convergent Reinforcement Learning algorithm that enables optimal tracking. Two real-world examples demonstrate the effectiveness of our new method.

eess.SY↗

Deep Decentralized Reinforcement Learning for Cooperative Control

In order to collaborate efficiently with unknown partners in cooperative control settings, adaptation of the partners based on online experience is required. The rather general and widely applicable control setting, where each cooperation partner might strive for individual goals while the control laws and objectives of the partners are unknown, entails various challenges such as the non-stationarity of the environment, the multi-agent credit assignment problem, the alter-exploration problem and the coordination problem. We propose new, modular deep decentralized Multi-Agent Reinforcement Learning mechanisms to account for these challenges. Therefore, our method uses a time-dependent prioritization of samples, incorporates a model of the system dynamics and utilizes variable, accountability-driven learning rates and simulated, artificial experiences in order to guide the learning process. The effectiveness of our method is demonstrated by means of a simulated, nonlinear cooperative control task.

cs.MA↗

Distributed Frequency Regulation for Heterogeneous Microgrids via Steady State Optimal Control

In this paper, we present a model-based frequency controller for microgrids with nonzero line resistances based on a port-Hamiltonian formulation of the microgrid model and real-time dynamic pricing. The controller is applicable for conventional generation with synchronous machines as well as for power electronics interfaced sources and it is robust against power fluctuations from uncontrollable loads or volatile regenerative sources. The price-based formulation allows additional requirements such as active power sharing to be met. The capability and effectiveness of our procedure is demonstrated by means of an 18-node exemplary grid.

eess.SY↗

Steady-State Optimal Frequency Control for Lossy Power Grids with Distributed Communication

We present a distributed and price-based control approach for frequency regulation in power grids with nonzero line conductances. Both grid and controller are modeled as a port-Hamiltonian system, where the grid model consists of differential as well as algebraic equations. Simulations show that the resulting controller asymptotically stabilizes the frequency while maintaining minimum overall generation costs in steady state and being robust in terms of clock drifts and uncontrollable loads. Moreover, it is shown that active power sharing can be achieved by an appropriate choice of the cost function.

eess.SY↗

Full- & Reduced-Order State-Space Modeling of Wind Turbine Systems with Permanent-Magnet Synchronous Generator

Wind energy is an integral part of nowadays energy supply and one of the fastest growing sources of electricity in the world today. Accurate models for wind energy conversion systems (WECSs) are of key interest for the analysis and control design of present and future energy systems. Existing control-oriented WECSs models are subject to unstructured simplifications, which have not been discussed in literature so far. Thus, this technical note presents are thorough derivation of a physical state-space model for permanent magnet synchronous generator WECSs. The physical model considers all dynamic effects that significantly influence the system's power output, including the switching of the power electronics. Alternatively, the model is formulated in the $(a,b,c)$- and $(d,q)$-reference frame. Secondly, a complete control and operation management system for the wind regimes II and III and the transition between the regimes is presented. The control takes practical effects such as input saturation and integral windup into account. Thirdly, by a structured model reduction procedure, two state-space models of WECS with reduced complexity are derived: a non-switching model and a non-switching reduced-order model. The validity of the models is illustrated and compared through a numerical simulation study.

eess.SY↗