TY - RPRT TI - Scaling Laws Across Model Architectures: A Comparative Analysis of Dense and MoE Models in Large Language Models AU - Siqi Wang AU - Zhengyu Chen AU - Bei Li AU - Keqing He AU - Min Zhang AU - Jingang Wang PY - 2024 UR - https://arxiv.org/abs/2410.05661 ID - 2410.05661 ER -