Searcharxiv⌕ Search

arXiv subjects

Kailang Xu

Publications and source records attributed to Kailang Xu.

3 recordsLinked to original sources

From Human Videos to Bimanual Dexterous Manipulation Data: Confidence-Guided RL Refinement of Video Priors

Collecting demonstrations for bimanual dexterous manipulation is costly, motivating the use of human videos as a source of robot training data. However, uncertainty in video-derived motion estimates and differences between human and robot embodiments make direct motion transfer challenging. In this work, we introduce PriDex, a framework that transforms human-video Priors into executable robot Dexterous manipulation demonstrations through reinforcement learning in simulation. PriDex preserves task-relevant interaction structure while allowing embodiment-specific behavior to be regenerated for the robot. Human-object interactions provide affordance cues for selecting task-relevant, robot-specific grasps from geometry-based candidates. For motion refinement, object trajectories provide a task-level reference, while relative bimanual wrist trajectories offer complementary guidance for coordinated motion. Since object-motion estimates can become unreliable under occlusion or visual ambiguity, PriDex uses object-motion confidence to adaptively balance these two priors, emphasizing object-level guidance when confidence is high and increasing the contribution of wrist-level guidance as confidence decreases. Reinforcement learning refines these video-derived priors under the robot's kinematic and physical constraints, and the resulting policies are rolled out to generate robot demonstrations for training a vision-based diffusion policy. We evaluate PriDex on four bimanual dexterous manipulation tasks, including pouring, sweeping into a dustpan, bottle-cap unscrewing, and plate cleaning, assessing both simulation-based robot data generation and downstream visuomotor policy learning.

cs.RO↗

Real-Time Prediction of Lower Limb Joint Kinematics, Kinetics, and Ground Reaction Force using Wearable Sensors and Machine Learning

Walking is a key movement of interest in biomechanics, yet gold-standard data collection methods are time- and cost-expensive. This paper presents a real-time, multimodal, high sample rate lower-limb motion capture framework, based on wireless wearable sensors and machine learning algorithms. Random Forests are used to estimate joint angles from IMU data, and ground reaction force (GRF) is predicted from instrumented insoles, while joint moments are predicted from angles and GRF using deep learning based on the ResNet-16 architecture. All three models achieve good accuracy compared to literature, and the predictions are logged at 1 kHz with a minimal delay of 23 ms for 20s worth of input data. The present work fully relies on wearable sensors, covers all five major lower limb joints, and provides multimodal comprehensive estimations of GRF, joint angles, and moments with minimal delay suitable for biofeedback applications.

eess.SY↗

Pressure-Induced Structural Phase Transition and a Special Amorphization Phase of Two-Dimensional Ferromagnetic Semiconductor Cr2Ge2Te6

Layered transition-metal trichalcogenides have become one of the research frontiers as two-dimensional magnets and candidate materials used for phase-change memory devices. Herein we report the high-pressure synchrotron X-ray diffraction and resistivity measurements on Cr2Ge2Te6 (CGT) single crystal by using diamond anvil cell techniques, which reveal a mixture of crystalline-to-crystalline and crystalline-to-amorphous transitions taking place concurrently at 18.3-29.2 GPa. The polymorphic transition could be interpreted by atomic layer reconstruction and the amorphization could be understood in connection with randomly flipping atoms into van der Waals gaps. The amorphous (AM) phase is quenchable to ambient conditions. The electrical resistance of CGT shows a bouncing point at ~ 18 GPa, consistent with the polymorphism phase transition. Interestingly, the high-pressure AM phase exhibits metallic resistance with the magnitude comparable to that of high-pressure crystalline phases, whereas the resistance of the AM phase at ambient pressure fails to exceed that of the crystalline phase, indicating that the AM phase of CGT appeared under high pressure is quite unique and similar behavior has never been observed in other phase-change materials. The results definitely would have significant implications for the design of new functional materials.

cond-mat.str-el↗