arXiv · 2604.25197
Optimization of Model Splitting, Placement, and Chaining for Multi-hop Split Learning and Inference
Abstract
Service Function Chaining (SFC) establishes efficient communication paths by ensuring that traffic traverses a predefined sequence of network functions in a specified order to meet particular service requirements. Inspired by this concept, we have proposed an SFC-based architecture for multi-hop split learning (MSL) and split inference (MSI), facilitating distributed AI applications to effectively route smashed data across multi-hop networks. However, the multi-hop environment presents new challenges, including (1) determining optimal cut points, (2) deploying split sub-models on appropriate computing nodes, and (3) routing smashed data through the underlying communication networks while adhering to service requirements. To address these challenges, we formulate an Integer Linear Programming (ILP) model to jointly optimize model splitting, placement, and chaining (data routing) in the SFC-based MSL/MSI architecture, aiming to minimize end-to-end inference or training latency. Additionally, we propose a Block Coordinate Descent (BCD)-based heuristic algorithm to efficiently solve the problem. Comprehensive evaluations demonstrate the effectiveness and characteristics of the proposed formulation and algorithm.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Takanori Hara, Masahiro Sasabe. 2026-04-28. Optimization of Model Splitting, Placement, and Chaining for Multi-hop Split Learning and Inference. https://arxiv.org/abs/2604.25197
Cite the original work for its findings. Save a collection to share your selection of sources.