arXiv subjects

Ruonan Zhao

Publications and source records attributed to Ruonan Zhao.

4 recordsLinked to original sources

arXiv2026

Optimization of the Railcar Assignment Problem Using Zone-based Double Deep Reinforcement Learning

Railcar switching, or shunting operations decisions play a significant role in the efficient operation of railyard systems, which are in turn critical to the fast and effective movement of goods. In flat yards, switching operations are primarily performed using locomotives to push and pull railcars in order to assemble and disassemble trains. In such settings, railcars with predefined destinations are located across multiple parallel rail tracks, and must be moved, or switched, in order to form desired outbound trains. This study addresses the Railcar Assignment Problem (RAP) in flat yards with an objective of minimizing the total number of switching movements. We present a novel mixed-integer programming (MIP) model for this problem that incorporates practical operational constraints in rail yards, and demonstrate its NP-hardness. To solve large-scale instances, we propose a comprehensive Zone-based Double Deep Q-Network (Zone-DDQN) heuristic method that integrates railway structure, yard-zone decomposition, and a Double Deep Q-Network (DDQN). The yard-zone decomposition strategy partitions the yard into multiple parallel yard zones, after which the DDQN is applied to solve the problem within each zone individually and sequentially. Computational experiments across small-, medium-, and large-scale yards were conducted on a series of RAP instances. Average results show that the Zone-DDQN heuristic achieves an average optimality gap of $5.71\%$ across small-scale yard instances. For large-scale yard instances containing more than 150 railcars and 30 tracks, the MIP model was not able to obtain solutions within 24 hours. In contrast, the Zone-DDQN heuristic was able to solve these instances with an average running time of 214.42 seconds.

math.OC↗

arXiv2026

A Novel Hybrid Heuristic-Reinforcement Learning Optimization Approach for a Class of Railcar Shunting Problems

Railcar shunting is a core planning task in freight railyards, where yard planners need to disassemble and reassemble groups of railcars to form outbound trains. Classification tracks with access from one side only can be considered as stack structures, where railcars are added and removed from only one end, leading to a last-in-first-out (LIFO) retrieval order. In contrast, two-sided tracks function like queue structures, allowing railcars to be added from one end and removed from the opposite end, following a first-in-first-out (FIFO) order. We consider a problem requiring assembly of multiple outbound trains using two locomotives in a railyard with two-sided classification track access. To address this combinatorially challenging problem class, we decompose the problem into two subproblems, each with one-sided classification track access and a locomotive on each side. We present a novel Hybrid Heuristic-Reinforcement Learning (HHRL) framework that integrates railway-specific heuristic solution approaches with a reinforcement learning method, specifically Q-learning. The proposed framework leverages methods to decrease the state-action space and guide exploration during reinforcement learning. The results of a series of numerical experiments demonstrate the efficiency and quality of the HHRL algorithm in both one-sided access, single-locomotive problems and two-sided access, two-locomotive problems.

cs.LG↗

arXiv2025

Optimizing Railcar Movements to Create Outbound Trains in a Freight Railyard

A typical freight railyard at a manufacturing facility contains multiple tracks used for storage, classification, and outbound train assembly. Individual railcar storage locations on classification tracks are often determined before knowledge of their destination locations is known, giving rise to railcar shunting or switching problems, which require retrieving subsets of cars distributed throughout the yard to assemble outbound trains. To address this combinatorially challenging problem class, we propose a large-scale mixed-integer programming model that tracks railcar movements and corresponding costs over a finite planning horizon. The model permits simultaneous movement of multiple car groups via a locomotive and seeks to minimize repositioning costs. We also provide a dynamic programming formulation of the problem, demonstrate the NP-hardness of the corresponding optimization problem, and present an adaptive railcar grouping dynamic programming (ARG-DP) heuristic, which groups railcars with common destinations for efficient moves. Average results from a series of numerical experiments demonstrate the efficiency and quality of the ARG-DP algorithm in both simulated yards and a real yard. On average, across 60 test cases of simulated yards, the ARG-DP algorithm obtains solutions 355 times faster than solving the mixed-integer programming model using a commercial solver, while finding an optimal solution in 60% of the instances and maintaining an average optimality gap of 6.65%. In 10 cases based on the Gaia railyard in Portugal, the ARG-DP algorithm achieves solutions 229 times faster on average, finding an optimal solution in 50% of the instances with an average optimality gap of 6.90%.

math.OC↗

arXiv2025

Recent Advances in Disaster Emergency Response Planning: Integrating Optimization, Machine Learning, and Simulation

The increasing frequency and severity of natural disasters underscore the critical importance of effective disaster emergency response planning to minimize human and economic losses. This survey provides a comprehensive review of recent advancements (2019--2024) in five essential areas of disaster emergency response planning: evacuation, facility location, casualty transport, search and rescue, and relief distribution. Research in these areas is systematically categorized based on methodologies, including optimization models, machine learning, and simulation, with a focus on their individual strengths and synergies. A notable contribution of this work is its examination of the interplay between machine learning, simulation, and optimization frameworks, highlighting how these approaches can address the dynamic, uncertain, and complex nature of disaster scenarios. By identifying key research trends and challenges, this study offers valuable insights to improve the effectiveness and resilience of emergency response strategies in future disaster planning efforts.

math.OC↗