TARGO and TARGO-Net: Benchmarking Target-driven Object Grasping under Occlusions
Predicting 6-DoF grasp poses from a single RGB-D frame has recently achieved impressive accuracy, yet performance can degrade significantly when the target object is heavily occluded by clutter. In this paper, we establish TARGO, the first benchmark dataset for TARget-driven Grasping under Occlusions, and introduce TARGO-Net, a grasp prediction model designed for visual occlusion. Our main contributions are fourfold: 1) We identify the visual occlusion challenge in single-view RGB-D 6-DoF grasping and show that current state-of-the-art models still suffer under severe occlusion. 2) We propose the TARGO dataset, which supports training and testing 6-DoF grasp models across different visual occlusion levels and enables robustness evaluation in real-world scenarios. 3) We devise TARGO-Net, a transformer-based grasping model with a target completion module and target-scene cross-attention, which achieves the most robust performance across all visual occlusion levels. 4) We show that target completion, number of occluders, and target minimum dimension also relate to grasp success in addition to visual occlusion.