TY - RPRT TI - Duplex: A Device for Large Language Models with Mixture of Experts, Grouped Query Attention, and Continuous Batching AU - Sungmin Yun AU - Kwanhee Kyung AU - Juhwan Cho AU - Jaewan Choi AU - Jongmin Kim AU - Byeongho Kim AU - Sukhan Lee AU - Kyomin Sohn AU - Jung Ho Ahn PY - 2024 DO - 10.1109/micro61859.2024.00105 UR - https://arxiv.org/abs/2409.01141 ID - 2409.01141 ER -