TY - RPRT TI - HeteGen: Heterogeneous Parallel Inference for Large Language Models on Resource-Constrained Devices AU - Xuanlei Zhao AU - Bin Jia AU - Haotian Zhou AU - Ziming Liu AU - Shenggan Cheng AU - Yang You PY - 2024 UR - https://arxiv.org/abs/2403.01164 ID - 2403.01164 ER -