TY  - RPRT
TI  - The Workload-Router-Pool Architecture for LLM Inference Optimization: A Vision Paper from the vLLM Semantic Router Project
AU  - Huamin Chen
AU  - Xunzhuo Liu
AU  - Bowei He
AU  - Fuyuan Lyu
AU  - Yankai Chen
AU  - Xue Liu
AU  - Yuhan Liu
AU  - Junchen Jiang
PY  - 2026
UR  - https://arxiv.org/abs/2603.21354
ID  - 2603.21354
ER  -