SearcharxivSearch

arXiv subjects

Qingdu Li

Publications and source records attributed to Qingdu Li.

9 recordsLinked to original sources

SRL: Combining SLIP Model and Reinforcement Learning for Agile Robotic Jumping

Robotic jumping is pivotal in applications such as search and rescue and logistics, where crossing obstacles and enhancing mobility efficiency are critical. The Spring-Loaded Inverted Pendulum (SLIP) model leverages simplified spring-mass dynamics that naturally encode biologically plausible hopping motions, yet its performance degrades on irregular terrain due to idealized assumptions regarding contact and joint dynamics. Meanwhile, Reinforcement Learning (RL) can adapt to diverse and complex environments but often requires extensive data from unguided exploration. The complementary strengths of SLIP's physically grounded baseline and RL's adaptive capabilities motivate a hybrid framework that overcomes these individual limitations. We therefore propose Spring-loaded Reinforcement Learning (SRL), which integrates SLIP-based feedforward control signals with RL-driven real-time feedback, enabling continuous optimization of robotic jumping. Experimental results demonstrate that SRL can achieve more stable jumps with much less training time than the baseline method, maintaining an average position tracking error below 0.1 m and velocity tracking errors within +/-3% of the target values. Through bipedal and quadrupedal simulations of ground and stair jumping, as well as sim-to-sim and sim-to-real validations, SRL exhibits robust adaptability to various task requirements and environmental complexities, underscoring its potential for real-world deployment.

cs.RO

Awakening Facial Emotional Expressions in Human-Robot

The facial expression generation capability of humanoid social robots is critical for achieving natural and human-like interactions, playing a vital role in enhancing the fluidity of human-robot interactions and the accuracy of emotional expression. Currently, facial expression generation in humanoid social robots still relies on pre-programmed behavioral patterns, which are manually coded at high human and time costs. To enable humanoid robots to autonomously acquire generalized expressive capabilities, they need to develop the ability to learn human-like expressions through self-training. To address this challenge, we have designed a highly biomimetic robotic face with physical-electronic animated facial units and developed an end-to-end learning framework based on KAN (Kolmogorov-Arnold Network) and attention mechanisms. Unlike previous humanoid social robots, we have also meticulously designed an automated data collection system based on expert strategies of facial motion primitives to construct the dataset. Notably, to the best of our knowledge, this is the first open-source facial dataset for humanoid social robots. Comprehensive evaluations indicate that our approach achieves accurate and diverse facial mimicry across different test subjects.

cs.RO

Catching Spinning Table Tennis Balls in Simulation with End-to-End Curriculum Reinforcement Learning

The game of table tennis is renowned for its extremely high spin rate, but most table tennis robots today struggle to handle balls with such rapid spin. To address this issue, we have contributed a series of methods, including: 1. Curriculum Reinforcement Learning (RL): This method helps the table tennis robot learn to play table tennis progressively from easy to difficult tasks. 2. Analysis of Spinning Table Tennis Ball Collisions: We have conducted a physics-based analysis to generate more realistic trajectories of spinning table tennis balls after collision. 3. Definition of Trajectory States: The definition of trajectory states aids in setting up the reward function. 4. Selection of Valid Rally Trajectories: We have introduced a valid rally trajectory selection scheme to ensure that the robot's training is not influenced by abnormal trajectories. 5. Reality-to-Simulation (Real2Sim) Transfer: This scheme is employed to validate the trained robot's ability to handle spinning balls in real-world scenarios. With Real2Sim, the deployment costs for robotic reinforcement learning can be further reduced. Moreover, the trajectory-state-based reward function is not limited to table tennis robots; it can be generalized to a wide range of cyclical tasks. To validate our robot's ability to handle spinning balls, the Real2Sim experiments were conducted. For the specific video link of the experiment, please refer to the supplementary materials.

cs.RO

FABG : End-to-end Imitation Learning for Embodied Affective Human-Robot Interaction

This paper proposes FABG (Facial Affective Behavior Generation), an end-to-end imitation learning system for human-robot interaction, designed to generate natural and fluid facial affective behaviors. In interaction, effectively obtaining high-quality demonstrations remains a challenge. In this work, we develop an immersive virtual reality (VR) demonstration system that allows operators to perceive stereoscopic environments. This system ensures "the operator's visual perception matches the robot's sensory input" and "the operator's actions directly determine the robot's behaviors" - as if the operator replaces the robot in human interaction engagements. We propose a prediction-driven latency compensation strategy to reduce robotic reaction delays and enhance interaction fluency. FABG naturally acquires human interactive behaviors and subconscious motions driven by intuition, eliminating manual behavior scripting. We deploy FABG on a real-world 25-degree-of-freedom (DoF) humanoid robot, validating its effectiveness through four fundamental interaction tasks: expression response, dynamic gaze, foveated attention, and gesture recognition, supported by data collection and policy training. Project website: https://cybergenies.github.io

cs.RO

Distributed Nonblocking Supervisory Control of Timed Discrete-Event Systems with Communication Delays and Losses

This paper investigates the problem of distributed nonblocking supervisory control for timed discrete-event systems (DESs). The distributed supervisors communicate with each other over networks subject to nondeterministic communication delays and losses. Given that the delays are counted by time, techniques have been developed to model the dynamics of the communication channels. By incorporating the dynamics of the communication channels into the system model, we construct a communication automaton to model the interaction process between the supervisors. Based on the communication automaton, we define the observation mappings for the supervisors, which consider delays and losses occurring in the communication channels. Then, we derive the necessary and sufficient conditions for the existence of a set of supervisors for distributed nonblocking supervisory control. These conditions are expressed as network controllability, network joint observability, and system language closure. Finally, an example of intelligent manufacturing is provided to show the application of the proposed framework.

eess.SY

Online State Estimation for Supervisor Synthesis in Discrete-Event Systems with Communication Delays and Losses

In the context of networked discrete-event systems (DESs), communication delays and losses exist between the plant and the supervisor for observation and between the supervisor and the actuator for control. In this paper, we first introduce a new framework for supervisory control of networked DESs. Under the introduced framework, we address the state estimation problem for supervisor synthesis of networked DESs with both communication delays and losses. The estimation algorithm considers the effect of the controls imposed on the system. Additionally, the estimation algorithm is based on the control decisions available up to the moment, and all the future control decisions are assumed to be unknowable. Two notions, called "observation channel configuration" for tracking observation delays and losses and "control channel configuration" for tracking control delays and losses, are defined. Then, we introduce an online approach for state estimation of the controlled system. Compared with the existing approach, the proposed approach under the introduced framework can estimate the state of the controlled system more accurately. As an application of the proposed approach, we finally show that the existing methods can be easily applied to synthesize maximally permissible and safe networked supervisors.

eess.SY

A New Approach for Verification of Delay Coobservability of Discrete-Event Systems

In decentralized networked supervisory control of discrete-event systems (DESs), the local supervisors observe event occurrences subject to observation delays to make correct control decisions. Delay coobservability describes whether these local supervisors can make sufficient observations. In this paper, we provide an efficient way to verify delay coobservability. For each controllable event, we partition the specification language into a finite number of sets such that strings in different sets have different lengths. For each of the sets, we construct a verifier to check if delay coobservability holds for the controllable event. The computational complexity of the proposed approach is polynomial with respect to the number of states, the number of events, and the upper bounds on observation delays and only exponential with respect to the number of local supervisors. It has lower complexity order than the existing approaches. In addition, we investigate the relationship between the decentralized supervisory control of networked DESs and the decentralized fault diagnosis of networked DESs and show that delay $K$-codiagnosability is transformable to delay coobservability. Thus, techniques for the verification of delay coobservability can be leveraged to verify delay $K$-codiagnosability.

eess.SY

Direct Computation of Two-Phase Icosahedral Equilibria of Lipid Bilayer Vesicles

Correctly formulated continuum models for lipid-bilayer membranes present a significant challenge to computational mechanics. In particular, the mid-surface behavior is that of a 2-dimensional fluid, while the membrane resists bending much like an elastic shell. Here we consider a well-known Helfrich-Cahn-Hilliard model for two-phase lipid-bilayer vesicles, incorporating mid-surface fluidity, curvature elasticity and a phase field. We present a systematic approach to the direct computation of vesical configurations possessing icosahedral symmetry, which have been observed in experiment and whose mathematical existence has recently been established. We first introduce a radial-graph formulation to overcome the difficulties associated with fluidity within a conventional Lagrangian description. We use the so-called subdivision surface finite element method combined with an icosahedral-symmetric mesh. The resulting discrete equations are well-conditioned and inherit equivariance properties under a representation of the icosahedral group. We use group-theoretic methods to obtain a reduced problem that captures all icosahedral-symmetric solutions of the full problem. Finally we explore the behavior of our reduced model, varying numerous physical parameters present in the mathematical model.

cond-mat.soft

Stability boundaries for wrinkling in highly stretched elastic sheets

We determine stability boundaries for the wrinkling of highly uni-directionally stretched, finely thin, rectangular elastic sheets. For a given fine thickness and length, a stability boundary here is a curve in the parameter plane, aspect ratio vs. the macroscopic strain; the values on one side of the boundary are associated with a flat, unwrinkled state, while wrinkled configurations correspond to all values on the other. In our recent work we demonstrated the importance of finite elasticity in the membrane part of such a model in order to capture the correct phenomena. Here we present and compare results for four distinct models:(i) the popular Föppl-von Kármán plate model (FvK), (ii) a correction of the latter, used in our earlier work, in which the approximate 2D Föppl strain tensor is replaced by the exact Green strain tensor, (iii) and (iv): effective 2D finite-elasticity membrane models based on 3D incompressible neo-Hookean and Mooney-Rivlin materials, respectively. In particular, (iii) and (iv) are superior models for elastomers. The 2D nonlinear, hyperelastic models (ii)-(iv) all incorporate the same quadratic bending energy used in FvK. Our results illuminate serious shortcomings of the latter in this problem, while also pointing to inaccuracies of model (ii), in spite of yielding the correct qualitative phenomena in our earlier work. In each of these, the shortcoming is a due to a deficiency of the membrane part of the model.

cond-mat.soft