Szilárd Aradi | Searcharxiv

arXiv2022

Efficient Real-time Rail Traffic Optimization: Decomposition of Rerouting, Reordering, and Rescheduling Problem

The railway timetables are designed in an optimal manner to maximize the capacity usage of the infrastructure concerning different objectives besides avoiding conflicts. The real-time railway traffic management problem occurs when the pre-planned timetable cannot be fulfilled due to various disturbances; therefore, the trains must be rerouted, reordered, and rescheduled. Optimizing the real-time railway traffic management aims to resolve the conflicts minimizing the delay propagation or even the energy consumption. In this paper, the existing mixed-integer linear programming optimization models are extended considering a safety-relevant issue of railway traffic management, the overlaps. However, solving the resulting model can be time-consuming in complex control areas and traffic situations involving many trains. Therefore, we propose different runtime efficient multi-stage heuristic models by decomposing the original problem. The impact of the model decomposition is investigated mathematically and experimentally in different rail networks and various simulated traffic scenarios concerning the objective value and the computational demand of the optimization. Besides providing a more realistic solution for the traffic management problem, the proposed multi-stage models significantly decrease the optimization runtime.

math.OC↗

arXiv2020

Survey of Deep Reinforcement Learning for Motion Planning of Autonomous Vehicles

Academic research in the field of autonomous vehicles has reached high popularity in recent years related to several topics as sensor technologies, V2X communications, safety, security, decision making, control, and even legal and standardization rules. Besides classic control design approaches, Artificial Intelligence and Machine Learning methods are present in almost all of these fields. Another part of research focuses on different layers of Motion Planning, such as strategic decisions, trajectory planning, and control. A wide range of techniques in Machine Learning itself have been developed, and this article describes one of these fields, Deep Reinforcement Learning (DRL). The paper provides insight into the hierarchical motion planning problem and describes the basics of DRL. The main elements of designing such a system are the modeling of the environment, the modeling abstractions, the description of the state and the perception models, the appropriate rewarding, and the realization of the underlying neural network. The paper describes vehicle models, simulation possibilities and computational requirements. Strategic decisions on different layers and the observation models, e.g., continuous and discrete state representations, grid-based, and camera-based solutions are presented. The paper surveys the state-of-art solutions systematized by the different tasks and levels of autonomous driving, such as car-following, lane-keeping, trajectory following, merging, or driving in dense traffic. Finally, open questions and future challenges are discussed.

cs.LG↗