SearcharxivSearch

arXiv subjects

Sibo Tian

Publications and source records attributed to Sibo Tian.

At least 19 recordsLinked to original sources

NeurRAFT: Robot Motion Planning via Anchor-Level Flow Matching with Clearance-Aware Preference Tuning

Recent end-to-end neural motion planners generate trajectories from raw sensor observations, avoiding the privileged geometric models required by classical planners. However, collision-free planning in cluttered environments remains challenging. We present NeurRAFT, a generative planning framework based on anchor-level flow matching and clearance-aware preference tuning. Unlike prior neural planners that model dense waypoint sequences and spend capacity on redundant local details and smoothness, NeurRAFT operates on compact anchor waypoints. We train the planner using a Jacobian-weighted loss that accounts for the task-space impact of each anchor. At inference, the anchors are generated in two integration steps, followed by cubic-spline interpolation to recover a smooth, full-resolution trajectory. Since imitation learning from positive demonstrations cannot distinguish collision-free from near-collision trajectories, collision-prone behaviors persist at test time. Rather than relying on post-hoc corrections, we directly reshape the pretrained planner's distribution toward safer solutions without augmenting inference. Specifically, Direct Preference Optimization shifts probability mass toward trajectories with larger obstacle clearance, with the resulting improvement directly absorbed into the planner parameters. Experiments show substantial improvements over state-of-the-art planners, while real-world experiments demonstrate zero-shot transfer to a Franka robot under noisy and partially occluded depth observations. Video results available at https://neurraft.github.io/.

cs.RO

Circulating Lymphocytes Preservation in Lung Cancer Stereotactic Body Radiation Therapy with Ultra-Fast Proton Delivery Using Modularized Pin Ridge Filters

Purpose: Radiation-induced lymphopenia is an increasingly recognized toxicity in lung radiotherapy and has been linked to radiation exposure to circulating lymphocytes (CL). In intensity-modulated proton therapy (IMPT), prolonged pencil beam scanning (PBS) delivery may increase CL dose. We recently developed a patient-specific pin ridge filter (pRF) framework that enables ultra-fast proton delivery with a single beam energy. This study evaluated whether pRF-based lung stereotactic body radiotherapy (SBRT) plans delivered at conventional (pRFCONV) and FLASH dose rates (pRFFLASH) improve immune sparing using time-resolved blood dose accumulation and CL survival modeling. Methods: pRF plans were created for 10 lung SBRT patients previously treated with IMPT. PBS delivery simulations modeled spot delivery, scanning, and energy switching. Blood dose-volume histograms (bDVHs) were calculated with the hematological dose framework. CL survival fractions (SF) were estimated from bDVHs with saturation and linear-quadratic models derived from in-vitro survival data for CD4/CD8 CL. Results: Compared with IMPT, pRFCONV/pRFFLASH plans reduced delivery time (mean reductions: 85.3/99.9%) and irradiated blood volume per fraction (mean reductions: 52.9/81.3%). pRFCONV/pRFFLASH plans reduced blood V5cGy by 26.4/39.4%, and V50cGy by 4.5/6.9%, respectively. pRF plans improved modeled CL survival across all models and subpopulations. Unstimulated CD4/CD8 CL had the largest SF differences, for which mean saturation-model SF improved by 7.9/8.6% for pRFCONV (p=0.03/0.02) and 9.6/10.4% for pRFFLASH (p=0.02/0.01), respectively. Conclusion: pRF plans improved modeled CL survival by significantly shortening delivery time and reducing irradiation of circulating blood. Our findings suggest that pRF's ultra-fast delivery may provide a practical strategy for immune sparing in proton lung SBRT.

physics.med-ph

Redefining End-of-Life: Intelligent Automation for Electronics Remanufacturing Systems

Remanufacturing is fundamentally more challenging than traditional manufacturing due to the significant uncertainty, variability, and incompleteness inherent in end-of-life (EoL) products. At the same time, it has become increasingly essential and urgent for facilitating a circular economy, driven by the growing volume of discarded electronic products and the escalating scarcity of critical materials. In this paper, we review the existing literature and examine the key challenges as well as emerging opportunities in intelligent automation for EoL electronics remanufacturing, providing a comprehensive overview of how robotics, control, and artificial intelligence (AI) can jointly enable scalable, safe, and intelligent remanufacturing systems. This paper starts with the definition, scope, and motivation of remanufacturing within the context of a circular economy, highlighting its societal and environmental significance. Then it delves into intelligent automation approaches for disassembly, inspection, sorting, and component reprocessing in this domain, covering advanced methods for multimodal perception, decision-making under uncertainty, flexible planning algorithms, and force-aware manipulation. The paper further reviews several emerging techniques, including large foundation models, human-in-the-loop integration, and digital twins that have the potential to support future research in this area. By integrating these topics, we aim to illustrate how next-generation remanufacturing systems can achieve robust, adaptable, and efficient operation in the face of complex real-world challenges.

eess.SY

SELF-VLA: A Skill Enhanced Agentic Vision-Language-Action Framework for Contact-Rich Disassembly

Disassembly automation has long been pursued to address the growing demand for efficient and proper recovery of valuable components from the end-of-life (EoL) electronic products. Existing approaches have demonstrated promising and regimented performance by decomposing the disassembly process into different subtasks. However, each subtask typically requires extensive data preparation, model training, and system management. Moreover, these approaches are often task- and component-specific, making them poorly suited to handle the variability and uncertainty of EoL products and limiting their generalization capabilities. All these factors restrict the practical deployment of current robotic disassembly systems and leave them highly reliant on human labor. With the recent development of foundation models in robotics, vision-language-action (VLA) models have shown impressive performance on standard robotic manipulation tasks, but their applicability to complex, contact-rich, and long-horizon industrial practices like disassembly, which requires sequential and precise manipulation, remains limited. To address this challenge, we propose SELF-VLA, an agentic VLA framework that integrates explicit disassembly skills. Experimental studies demonstrate that our framework significantly outperforms current state-of-the-art end-to-end VLA models on two contact-rich disassembly tasks. The video illustration can be found via https://zh.engr.tamu.edu/wp-content/uploads/sites/310/2026/03/IROS-VLA-Video.mp4.

cs.RO

PrediFlow: A Flow-Based Prediction-Refinement Framework for Real-Time Human Motion Prediction in Human-Robot Collaboration

Stochastic human motion prediction is critical for safe and effective human-robot collaboration (HRC) in industrial remanufacturing, as it captures human motion uncertainties and multi-modal behaviors that deterministic methods cannot handle. While earlier works emphasize highly diverse predictions, they often generate unrealistic human motions. More recent methods focus on accuracy and real-time performance, yet there remains potential to improve prediction quality further without exceeding time budgets. Additionally, current research on stochastic human motion prediction in HRC typically considers human motion in isolation, neglecting the influence of robot motion on human behavior. To address these research gaps and enable real-time, realistic, and interaction-aware human motion prediction, we propose a novel prediction-refinement framework that integrates both human and robot observed motion to refine the initial predictions produced by a pretrained state-of-the-art predictor. The refinement module employs a Flow Matching structure to account for uncertainty. Experimental studies on the HRC desktop disassembly dataset demonstrate that our method significantly improves prediction accuracy while preserving the uncertainties and multi-modalities of human motion. Moreover, the total inference time of the proposed framework remains within the time budget, highlighting the effectiveness and practicality of our approach.

cs.RO

Vision-Language-Action Models for Selective Robotic Disassembly: A Case Study on Critical Component Extraction from Desktops

Automating disassembly of critical components from end-of-life (EoL) desktops, such as high-value items like RAM modules and CPUs, as well as sensitive parts like hard disk drives, remains challenging due to the inherent variability and uncertainty of these products. Moreover, their disassembly requires sequential, precise, and dexterous operations, further increasing the complexity of automation. Current robotic disassembly processes are typically divided into several stages: perception, sequence planning, task planning, motion planning, and manipulation. Each stage requires explicit modeling, which limits generalization to unfamiliar scenarios. Recent development of vision-language-action (VLA) models has presented an end-to-end approach for general robotic manipulation tasks. Although VLAs have demonstrated promising performance on simple tasks, the feasibility of applying such models to complex disassembly remains largely unexplored. In this paper, we collected a customized dataset for robotic RAM and CPU disassembly and used it to fine-tune two well-established VLA approaches, OpenVLA and OpenVLA-OFT, as a case study. We divided the whole disassembly task into several small steps, and our preliminary experimental results indicate that the fine-tuned VLA models can faithfully complete multiple early steps but struggle with certain critical subtasks, leading to task failure. However, we observed that a simple hybrid strategy that combines VLA with a rule-based controller can successfully perform the entire disassembly operation. These findings highlight the current limitations of VLA models in handling the dexterity and precision required for robotic EoL product disassembly. By offering a detailed analysis of the observed results, this study provides insights that may inform future research to address current challenges and advance end-to-end robotic automated disassembly.

cs.RO

Warm-Starting Optimization-Based Motion Planning for Robotic Manipulators via Point Cloud-Conditioned Flow Matching

Rapid robot motion generation is critical in Human-Robot Collaboration (HRC) systems, as robots need to respond to dynamic environments in real time by continuously observing their surroundings and replanning their motions to ensure both safe interactions and efficient task execution. Current sampling-based motion planners face challenges in scaling to high-dimensional configuration spaces and often require post-processing to interpolate and smooth the generated paths, resulting in time inefficiency in complex environments. Optimization-based planners, on the other hand, can incorporate multiple constraints and generate smooth trajectories directly, making them potentially more time-efficient. However, optimization-based planners are sensitive to initialization and may get stuck in local minima. In this work, we present a novel learning-based method that utilizes a Flow Matching model conditioned on a single-view point cloud to learn near-optimal solutions for optimization initialization. Our method does not require prior knowledge of the environment, such as obstacle locations and geometries, and can generate feasible trajectories directly from single-view depth camera input. Simulation studies on a UR5e robotic manipulator in cluttered workspaces demonstrate that the proposed generative initializer achieves a high success rate on its own, significantly improves the success rate of trajectory optimization compared with traditional and learning-based benchmark initializers, requires fewer optimization iterations, and exhibits strong generalization to unseen environments.

cs.RO

Clinically Interpretable Survival Risk Stratification in Head and Neck Cancer Using Bayesian Networks and Markov Blankets

Purpose: To identify a clinically interpretable subset of survival-relevant features in HN cancer using Bayesian Network (BN) and evaluate its prognostic and causal utility. Methods and Materials: We used the RADCURE dataset, consisting of 3,346 patients with H&N cancer treated with definitive (chemo)radiotherapy. A probabilistic BN was constructed to model dependencies among clinical, anatomical, and treatment variables. The Markov Blanket (MB) of two-year survival (SVy2) was extracted and used to train a logistic regression model. After excluding incomplete cases, a temporal split yielded a train/test (2,174/820) dataset using 2007 as the cutoff year. Model performance was assessed using area under the ROC curve (AUC), C-index, and Kaplan-Meier (KM) survival stratification. Model fit was further evaluated using a log-likelihood ratio (LLR) test. Causal inference was performed using do-calculus interventions on MB variables. Results: The MB of SVy2 included 6 clinically relevant features: ECOG performance status, T-stage, HPV status, disease site, the primary gross tumor volume (GTVp), and treatment modality. The model achieved an AUC of 0.65 and C-index of 0.78 on the test dataset, significantly stratifying patients into high- and low-risk groups (log-rank p < 0.01). Model fit was further supported by a log-likelihood ratio of 70.32 (p < 0.01). Subgroup analyses revealed strong performance in HPV-negative (AUC = 0.69, C-index = 0.76), T4 (AUC = 0.69, C-index = 0.80), and large-GTV (AUC = 0.67, C-index = 0.75) cohorts, each showing significant KM separation. Causal analysis further supported the positive survival impact of ECOG 0, HPV-positive status, and chemoradiation. Conclusions: A compact, MB-derived BN model can robustly stratify survival risk in HN cancer. The model enables explainable prognostication and supports individualized decision-making across key clinical subgroups.

physics.med-ph

Stereotactic Arrhythmia Radioablation for Refractory Ventricular Tachycardia: A Narrative Review and Exploratory Pooled Analysis of Clinical Outcomes and Toxicity

Purpose: Stereotactic arrhythmia radioablation (STAR) is a non-invasive salvage therapy for refractory ventricular tachycardia (VT), especially in patients ineligible for catheter ablation. This narrative review and pooled analysis evaluates the safety, efficacy, and technical characteristics of STAR, integrating preclinical studies, case reports, case series, and clinical trials. Methods and Materials: A comprehensive review identified 86 studies published between 2015 and 2025, including 12 preclinical studies, 49 case reports, 18 case series, and 7 clinical trials. Study-level data were extracted for pooled analysis of 6- and 12-month mortality, VT burden reduction, and grade 3+ acute toxicities. Subgroup analyses were performed by delivery modality, age, left ventricular ejection fraction (LVEF), and cardiomyopathy type. Results: Pooled mortality was 16% (95% CI: 11-20%) at 6 months and 33% (95% CI: 27-38%) at 12 months. VT burden reduction at 6 months averaged 75% (95% CI: 73-77%) but showed substantial heterogeneity (I^2 = 98.8%). Grade 3+ acute toxicities occurred in 7% (95% CI: 4-10%), with heart failure being most common. Subgroup analyses suggested better outcomes in younger patients, those with NICM, and those with higher LVEF. Conclusions: STAR is a promising salvage therapy with favorable acute safety and efficacy. Outcome heterogeneity and inconsistent reporting highlight the need for standardized definitions, dosimetric protocols, and longer-term follow-up. Prospective trials and real-world registries are critical for refining STAR's role in VT management.

physics.med-ph

A Comparative Dosimetric Study of Proton and Photon Therapy in Stereotactic Arrhythmia Radioablation for Ventricular Tachycardia

Purpose: VT is a life-threatening arrhythmia commonly treated with catheter ablation; however, some cases remain refractory to conventional treatment. STAR has emerged as a non-invasive option for such patients. While photon-based STAR has shown efficacy, proton therapy offers potential advantages due to its superior dose conformity and sparing of critical OARs, including the heart itself. This study aims to investigate and compare the dosimetry between proton and photon therapy for VT, focusing on target coverage and OAR sparing. Methods: We performed a retrospective study on a cohort of 34 VT patients who received photon STAR. Proton STAR plans were generated using robust optimization in RayStation to deliver the same prescription dose of 25 Gy in a single fraction while minimizing dose to OARs. Dosimetric metrics, including D99, D95, Dmean, and D0.03cc, were extracted for critical OARs and VAS. Shapiro-Wilk tests were used to assess normality, followed by paired t-tests or Wilcoxon signed-rank tests for statistical comparisons between modalities, with Bonferroni correction applied for multiple comparisons. Results: Proton and photon plans achieved comparable target coverage, with VAS D95 of 24.1 +/- 1.2 Gy vs. 24.7 +/- 1.0 Gy (p=0.294). Proton therapy significantly reduced OAR doses, including heart Dmean (3.6 +/- 1.5 Gy vs. 5.5 +/- 2.0 Gy, p<0.001), lungs Dmean (1.6 +/- 1.5 Gy vs. 2.1 +/- 1.4 Gy, p<0.001), and esophagus Dmean (0.3 +/- 0.6 Gy vs. 1.6 +/- 1.3 Gy, p<0.001), while maintaining optimal target coverage. Conclusion: Proton therapy for STAR demonstrates significant dosimetric advantages in sparing the heart and other critical OARs compared to photon therapy for VT, while maintaining equivalent target coverage. These findings highlight the potential of proton therapy to reduce treatment-related toxicity and improve outcomes for VT patients.

physics.med-ph

Bayesian-Optimized One-Step Diffusion Model with Knowledge Distillation for Real-Time 3D Human Motion Prediction

Human motion prediction is a cornerstone of human-robot collaboration (HRC), as robots need to infer the future movements of human workers based on past motion cues to proactively plan their motion, ensuring safety in close collaboration scenarios. The diffusion model has demonstrated remarkable performance in predicting high-quality motion samples with reasonable diversity, but suffers from a slow generative process which necessitates multiple model evaluations, hindering real-world applications. To enable real-time prediction, in this work, we propose training a one-step multi-layer perceptron-based (MLP-based) diffusion model for motion prediction using knowledge distillation and Bayesian optimization. Our method contains two steps. First, we distill a pretrained diffusion-based motion predictor, TransFusion, directly into a one-step diffusion model with the same denoiser architecture. Then, to further reduce the inference time, we remove the computationally expensive components from the original denoiser and use knowledge distillation once again to distill the obtained one-step diffusion model into an even smaller model based solely on MLPs. Bayesian optimization is used to tune the hyperparameters for training the smaller diffusion model. Extensive experimental studies are conducted on benchmark datasets, and our model can significantly improve the inference speed, achieving real-time prediction without noticeable degradation in performance.

cs.CV

Grasping Force Control and Adaptation for a Cable-Driven Robotic Hand

This paper introduces a unique force control and adaptation algorithm for a lightweight and low-complexity five-fingered robotic hand, namely an Integrated-Finger Robotic Hand (IFRH). The force control and adaptation algorithm is intuitive to design, easy to implement, and improves the grasping functionality through feedforward adaptation automatically. Specifically, we have extended Youla-parameterization which is traditionally used in feedback controller design into a feedforward iterative learning control algorithm (ILC). The uniqueness of such an extension is that both the feedback and feedforward controllers are parameterized over one unified design parameter which can be easily customized based on the desired closed-loop performance. While Youla-parameterization and ILC have been explored in the past on various applications, our unique parameterization and computational methods make the design intuitive and easy to implement. This provides both robust and adaptive learning capabilities, and our application rivals the complexity of many robotic hand control systems. Extensive experimental tests have been conducted to validate the effectiveness of our method.

cs.RO

Integrating Uncertainty-Aware Human Motion Prediction into Graph-Based Manipulator Motion Planning

There has been a growing utilization of industrial robots as complementary collaborators for human workers in re-manufacturing sites. Such a human-robot collaboration (HRC) aims to assist human workers in improving the flexibility and efficiency of labor-intensive tasks. In this paper, we propose a human-aware motion planning framework for HRC to effectively compute collision-free motions for manipulators when conducting collaborative tasks with humans. We employ a neural human motion prediction model to enable proactive planning for manipulators. Particularly, rather than blindly trusting and utilizing predicted human trajectories in the manipulator planning, we quantify uncertainties of the neural prediction model to further ensure human safety. Moreover, we integrate the uncertainty-aware prediction into a graph that captures key workspace elements and illustrates their interconnections. Then a graph neural network is leveraged to operate on the constructed graph. Consequently, robot motion planning considers both the dependencies among all the elements in the workspace and the potential influence of future movements of human workers. We experimentally validate the proposed planning framework using a 6-degree-of-freedom manipulator in a shared workspace where a human is performing disassembling tasks. The results demonstrate the benefits of our approach in terms of improving the smoothness and safety of HRC. A brief video introduction of this work is available as the supplemental materials.

cs.RO

KG-Planner: Knowledge-Informed Graph Neural Planning for Collaborative Manipulators

This paper presents a novel knowledge-informed graph neural planner (KG-Planner) to address the challenge of efficiently planning collision-free motions for robots in high-dimensional spaces, considering both static and dynamic environments involving humans. Unlike traditional motion planners that struggle with finding a balance between efficiency and optimality, the KG-Planner takes a different approach. Instead of relying solely on a neural network or imitating the motions of an oracle planner, our KG-Planner integrates explicit physical knowledge from the workspace. The integration of knowledge has two key aspects: (1) we present an approach to design a graph that can comprehensively model the workspace's compositional structure. The designed graph explicitly incorporates critical elements such as robot joints, obstacles, and their interconnections. This representation allows us to capture the intricate relationships between these elements. (2) We train a Graph Neural Network (GNN) that excels at generating nearly optimal robot motions. In particular, the GNN employs a layer-wise propagation rule to facilitate the exchange and update of information among workspace elements based on their connections. This propagation emphasizes the influence of these elements throughout the planning process. To validate the efficacy and efficiency of our KG-Planner, we conduct extensive experiments in both static and dynamic environments. These experiments include scenarios with and without human workers. The results of our approach are compared against existing methods, showcasing the superior performance of the KG-Planner. A short video introduction of this work is available (video link provided in the paper).

cs.RO

A Recurrent Neural Network Enhanced Unscented Kalman Filter for Human Motion Prediction

This paper presents a deep learning enhanced adaptive unscented Kalman filter (UKF) for predicting human arm motion in the context of manufacturing. Unlike previous network-based methods that solely rely on captured human motion data, which is represented as bone vectors in this paper, we incorporate a human arm dynamic model into the motion prediction algorithm and use the UKF to iteratively forecast human arm motions. Specifically, a Lagrangian-mechanics-based physical model is employed to correlate arm motions with associated muscle forces. Then a Recurrent Neural Network (RNN) is integrated into the framework to predict future muscle forces, which are transferred back to future arm motions based on the dynamic model. Given the absence of measurement data for future human motions that can be input into the UKF to update the state, we integrate another RNN to directly predict human future motions and treat the prediction as surrogate measurement data fed into the UKF. A noteworthy aspect of this study involves the quantification of uncertainties associated with both the data-driven and physical models in one unified framework. These quantified uncertainties are used to dynamically adapt the measurement and process noises of the UKF over time. This adaption, driven by the uncertainties of the RNN models, addresses inaccuracies stemming from the data-driven model and mitigates discrepancies between the assumed and true physical models, ultimately enhancing the accuracy and robustness of our predictions. Compared to the traditional RNN-based prediction, our method demonstrates improved accuracy and robustness in extensive experimental validations of various types of human motions.

cs.RO

Streamlined Pin-Ridge-Filter Design for Single-energy Proton FLASH Planning

Purpose: This study explored the feasibility of a streamlined pin-shaped ridge filter (pin-RF) design for single-energy proton FLASH planning. Methods: An inverse planning framework integrated within a TPS was established for FLASH planning. The framework involves generating a IMPT plan based on downstream energy modulation strategy (IMPT-DS), followed by a nested spot reduction process to iteratively reduce the total number of pencil beam directions (PBDs) and energy layers along each PBD for the IMPT-DS plan. The IMPT-DS plan is then translated into the pin-RFs for a single-energy IMPT plan (IMPT-RF). The framework was validated on three lung cases, quantifying the FLASH dose of the IMPT-RF plan using the FLASH effectiveness model and comparing it with the reference dose of a conventional IMPT plan to assess the clinical benefit of the FLASH planning technique. Results: The IMPT-RF plans closely matched the corresponding IMPT-DS plans in high dose conformity, with minimal changes in V7Gy and V7.4Gy for the lung (< 5%) and small increases in Dmax for other OARs (< 3.2 Gy). Comparing the FLASH doses to the doses of corresponding IMPT-RF plans, drastic reductions of up to ~33% were observed in Dmax for OARs in the high-to-moderate-dose regions with negligible changes in Dmax for OARs in low-dose regions. Positive clinical benefits were observed with notable reductions of 18.4-33.0% in Dmax for OARs in the high-dose regions. However, in the moderate-to-low-dose regions, only marginal positive or even negative clinical benefit for OARs were observed, such as increased lung V7Gy and V7.4Gy (16.4-38.9%). Conclusions: A streamlined pin-RF design for single-energy proton FLASH planning was validated, revealing positive clinical benefits for OARs in the high dose regions. The coarsened design of the pin-RF demonstrates potential cost efficiency and efficient production.

physics.med-ph

TransFusion: A Practical and Effective Transformer-based Diffusion Model for 3D Human Motion Prediction

Predicting human motion plays a crucial role in ensuring a safe and effective human-robot close collaboration in intelligent remanufacturing systems of the future. Existing works can be categorized into two groups: those focusing on accuracy, predicting a single future motion, and those generating diverse predictions based on observations. The former group fails to address the uncertainty and multi-modal nature of human motion, while the latter group often produces motion sequences that deviate too far from the ground truth or become unrealistic within historical contexts. To tackle these issues, we propose TransFusion, an innovative and practical diffusion-based model for 3D human motion prediction which can generate samples that are more likely to happen while maintaining a certain level of diversity. Our model leverages Transformer as the backbone with long skip connections between shallow and deep layers. Additionally, we employ the discrete cosine transform to model motion sequences in the frequency space, thereby improving performance. In contrast to prior diffusion-based models that utilize extra modules like cross-attention and adaptive layer normalization to condition the prediction on past observed motion, we treat all inputs, including conditions, as tokens to create a more lightweight model compared to existing approaches. Extensive experimental studies are conducted on benchmark datasets to validate the effectiveness of our human motion prediction model.

cs.RO

DE-TGN: Uncertainty-Aware Human Motion Forecasting using Deep Ensembles

Ensuring the safety of human workers in a collaborative environment with robots is of utmost importance. Although accurate pose prediction models can help prevent collisions between human workers and robots, they are still susceptible to critical errors. In this study, we propose a novel approach called deep ensembles of temporal graph neural networks (DE-TGN) that not only accurately forecast human motion but also provide a measure of prediction uncertainty. By leveraging deep ensembles and employing stochastic Monte-Carlo dropout sampling, we construct a volumetric field representing a range of potential future human poses based on covariance ellipsoids. To validate our framework, we conducted experiments using three motion capture datasets including Human3.6M, and two human-robot interaction scenarios, achieving state-of-the-art prediction error. Moreover, we discovered that deep ensembles not only enable us to quantify uncertainty but also improve the accuracy of our predictions.

cs.RO