Willem Feijen | Searcharxiv

arXiv2024

Learning-Enhanced Neighborhood Selection for the Vehicle Routing Problem with Time Windows

Large Neighborhood Search (LNS) is a universal approach that is broadly applicable and has proven to be highly efficient in practice for solving optimization problems. We propose to integrate machine learning (ML) into LNS to assist in deciding which parts of the solution should be destroyed and repaired in each iteration of LNS. We refer to our new approach as Learning-Enhanced Neighborhood Selection (LENS for short). Our approach is universally applicable, i.e., it can be applied to any LNS algorithm to amplify the workings of the destroy algorithm. In this paper, we demonstrate the potential of LENS on the fundamental Vehicle Routing Problem with Time Windows (VRPTW). We implemented an LNS algorithm for VRPTW and collected data on generated novel training instances derived from well-known, extensively utilized benchmark datasets. We trained our LENS approach with this data and compared the experimental results of our approach with two benchmark algorithms: a random neighborhood selection method to show that LENS learns to make informed choices and an oracle neighborhood selection method to demonstrate the potential of our LENS approach. With LENS, we obtain results that significantly improve the quality of the solutions.

cs.LG↗

arXiv2023

Dijkstras algorithm with predictions to solve the single-source many-targets shortest-path problem

We study the use of machine learning techniques to solve a fundamental shortest path problem, known as the single-source many-targets shortest path problem (SSMTSP). Given a directed graph with non-negative edge weights, our goal is to compute a shortest path from a given source node to any of several target nodes. Basically, our idea is to equip an adapted version of Dijkstras algorithm with machine learning predictions to solve this problem: Based on the trace of the algorithm, we design a neural network that predicts the shortest path distance after a few iterations. The prediction is then used to prune the search space explored by Dijkstras algorithm, which may significantly reduce the number of operations on the underlying priority queue. We note that our algorithm works independently of the specific method that is used to arrive at such predictions. Crucially, we require that our algorithm always computes an optimal solution (independently of the accuracy of the prediction) and provides a certificate of optimality. As we show, in the worst-case this might force our algorithm to use the same number of queue operations as Dijkstras algorithm, even if the prediction is correct. In general, however, our algorithm may save a significant fraction of the priority queue operations. We derive structural insights that allow us to lower bound these savings on partial random instances. In these instances, an adversary can fix the instance arbitrarily except for the weights of a subset of relevant edges, which are chosen randomly. Our bound shows that the number of relevant edges which are pruned increases as the prediction error decreases. We then use these insights to derive closed-form expressions of the expected number of saved queue operations on random instances.

cs.DS↗