Searcharxiv⌕ Search

arXiv subjects

Haiwen Wu

Publications and source records attributed to Haiwen Wu.

4 recordsLinked to original sources

Epigraph Form Reinforcement Learning-based Safe Trajectory Tracking Control for Connected and Autonomous Vehicles

Safe trajectory tracking (STT) aims to enable autonomous vehicles to follow a reference trajectory accurately while avoiding collisions. This problem is particularly challenging for Connected and Autonomous Vehicles (CAVs) in highly dynamic environments. Existing non-learning-based STT methods often use simplified vehicle and interaction models to meet real-time requirements, which may result in suboptimal tracking accuracy. Although Deep Reinforcement Learning (DRL) can help address this limitation, widely used Lagrangian DRL methods often suffer from unstable training because increasing Lagrange multipliers amplify policy-gradient magnitudes. To address these issues, we propose a novel reinforcement learning framework for STT, called STT Control Epigraph Form RL (STTC-EFRL). In this framework, the STT problem is formulated as an epigraph-form min-max optimization problem. Based on this formulation, we develop a learning mechanism that uses a decreasing scalar related to the epigraph to adjust the policy gradient descent direction without increasing the gradient magnitude, thereby improving training stability. We also develop a computationally efficient ray-casting method to compute a polyhedron scaling factor for safety quantification. Experimental results, including Vehicle-in-the-Loop tests, show that STTC-EFRL achieves higher tracking accuracy than the considered non-learning-based baseline and more stable training than widely used Lagrangian DRL methods, while satisfying safety requirements in connected environments.

cs.LG↗

Velocity-free task-space regulator for robot manipulators with external disturbances

This paper addresses the problem of task-space robust regulation of robot manipulators subject to external disturbances. A velocity-free control law is proposed by combining the internal model principle and the passivity-based output-feedback control approach. The resulting controller not only ensures asymptotic convergence of the regulation error but also rejects unwanted external sinusoidal disturbances. The potential of the proposed method lies in its simplicity, intuitiveness, and straightforward gain selection criteria for the synthesis of multi-joint robot manipulator control systems.

eess.SY↗

Distributed formation control for manipulator end-effectors

We present three classes of distributed formation controllers for achieving and maintaining the 2D/3D formation shape of manipulator end-effectors to cope with different scenarios due to availability of modeling parameters. We firstly present a distributed formation controller for manipulators whose system parameters are perfectly known. The formation control objective is achieved by assigning virtual springs between end-effectors and by adding damping terms at joints, which provides a clear physical interpretation of the proposed solution. Subsequently, we extend it to the case where manipulator kinematic and system parameters are not exactly known. An extra integrator and an adaptive estimator are introduced for gravitational compensation and stabilization, respectively. Simulation results with planar manipulators and with seven degree-of-freedom humanoid manipulator arms are presented to illustrate the effectiveness of the proposed approach.

cs.RO↗

Distributed formation control of manipulators' end-effector with internal model-based disturbance rejection

This paper addresses the problem of end-effector formation control for manipulators that are subjected to external disturbances: input disturbance torques and disturbance forces at each end-effector. The disturbances are assumed to be non-vanishing and are superposition of finite number of sinusoidal and step signals. The formation control objective is achieved by assigning virtual springs between end-effectors, by adding damping terms at joints, and by incorporating internal model-based dynamic compensators to counteract the effect of the disturbances; all of which presents a clear physical interpretation of the proposed approach. Simulation results are presented to illustrate the effectiveness of the proposed approach.

cs.RO↗