arXiv subjects

Jicheng Chen

Publications and source records attributed to Jicheng Chen.

3 recordsLinked to original sources

arXiv2026

FastTPS: An Optimized Method for LLM Token Phase for AI accelerators

The popularity of large language models (LLMs) escalates an ongoing demand for effective inference. However, due to the sequential processing of tokens during the token phase in decoder-only LLMs inference, the inherent low parallelism leads to reduced throughput and suboptimal utilization of the computing units on artificial intelligence (AI) accelerators, particularly when handling long-sequence inputs that impose significant memory overhead. Recently, many reported methods have been developed as potential solutions, since they emerge with numeric deviation. This paper presents FastTPS, a high performance and low-precision loss method for accelerating the token-phase in LLM inference on general AI accelerators which includes three key components: (1) AI accelerator-enabled reloading-free KV Cache concatenation which decreases memory access overhead as well as enables full fusion of Attention, (2) high-efficiency and high-accuracy 'RoPE' attention based on the tiling optimized FLAT, and (3) highly-fused MLP with fine-grain pipeline scheduling. Our results confirm that FastTPS significantly alleviates memory bottlenecks in the token phase, delivering a 6x speed improvement (compared to none-fusion) on an AMD Ryzen AI 300 series NPU with BF16 precision while sustaining 93% peak memory bandwidth utilization during Phi3-mini-4k-instruct inference.

cs.LG↗

arXiv2025

PGD-based optimization of 3D bobsleigh track centerlines from 2D centerlines for simulation applications

The centerline of a bobsleigh track defines its geometry and is essential for simulation modeling. To reduce bBobsleigh training costs, leveraging the centerline of the bobsleigh track to construct a virtual environment that closely replicates real competitive settings presents a promising solution. However, publicly available centerline data are typically limited and it is imprecise to construct a training system solely based on 2-dimensional (2D) centerline. To address this practical issue, this paper proposes a method for generating a 3-dimensional (3D) track centerline based on 2D centerline data. Incorporating international track design regulations, the method formulates an optimization problem that considers total track length, height difference, slope constraints, and geometric continuity. A Projected Gradient Descent (PGD) algorithm is used to solve the optimization problem. The generated 3D centerlines are compared with real track data, and the results show that the method can reproduce realistic centerline trends from original or scaled 2D data. For the selected track segment, the relative errors in total length, height difference, and average slope are within 1.7%, 3.2% and 4.1%, respectively, for real 2D data and within 1.1%, 3.5% and 4.3% respectively for scaled data. All slope values remain within the allowable limits. Moreover, by adjusting the segmentation or modifying the weight of height difference in the cost function, various centerline styles applicable to different competitions can be generated. Under different segmentation and weight factors, the maximum errors reach up to 4.4%, 4.8%, and 9.8%, and 4.4%, 4.8%, and 10.0%, respectively. The proposed method provides a flexible and efficient tool for supporting bobsleigh track centerline design.

eess.SY↗

arXiv2020

Integral-Type Event-Triggered Model Predictive Control of Nonlinear Systems with Additive Disturbance

This paper studies integral-type event-triggered model predictive control (MPC) of continuous-time nonlinear systems. An integral-type event-triggered mechanism is proposed by incorporating the integral of errors between the actual and predicted state sequences, leading to reduced average sampling frequency. Besides, a new and improved robustness constraint is introduced to handle the additive disturbance, rendering the MPC problem with a potentially enlarged initial feasible region. Furthermore, the feasibility of the designed MPC and the stability of the closed-loop system are rigorously investigated. Several sufficient conditions to guarantee these properties are established, which is related to factors such as the prediction horizon, the disturbance bound, the triggering level, and the contraction rate for the robustness constraint. The effectiveness of the proposed algorithm is illustrated by numerical examples and comparisons.

math.OC↗