Should We Learn Contact-Rich Manipulation Policies From Sampling-Based Planners?

Huaijiang Zhu, Tong Zhao, Xinpei Ni, Jiuguang Wang, Kuan Fang, Ludovic Righetti, Tao Pang

Research output: Contribution to journalArticlepeer-review

Abstract

The tremendous success of behavior cloning (BC) in robotic manipulation has been largely confined to tasks where demonstrations can be effectively collected through human teleoperation. However, demonstrations for contact-rich manipulation tasks that require complex coordination of multiple contacts are difficult to collect due to the limitations of current teleoperation interfaces. We investigate how to leverage model-based planning and optimization to generate training data for contact-rich dexterous manipulation tasks. Our analysis reveals that popular sampling-based planners like rapidly exploring random tree (RRT), while efficient for motion planning, produce demonstrations with unfavorably high entropy. This motivates modifications to our data generation pipeline that prioritizes demonstration consistency while maintaining solution coverage. Combined with a diffusion-based goal-conditioned BC approach, our method enables effective policy learning and zero-shot transfer to hardware for two challenging contact-rich manipulation tasks.

Original languageEnglish (US)
Pages (from-to)6248-6255
Number of pages8
JournalIEEE Robotics and Automation Letters
Volume10
Issue number6
DOIs
StatePublished - 2025

Keywords

  • Bimanual manipulation
  • deep learning in grasping and manipulation
  • dexterous manipulation

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Biomedical Engineering
  • Human-Computer Interaction
  • Mechanical Engineering
  • Computer Vision and Pattern Recognition
  • Computer Science Applications
  • Control and Optimization
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'Should We Learn Contact-Rich Manipulation Policies From Sampling-Based Planners?'. Together they form a unique fingerprint.

Cite this