OpenViTac: Learning and Benchmarking Visuo-Tactile Policies in a Unified Sim-and-Real Framework

Key points

• Tactile feedback provides embodied agents with physical information beyond visual observations, enabling more reliable interaction with the real world.1
• However, despite the rapid progress of vision-tactile-language-action (VTLA) policies, there remains a lack of unified benchmarks for evaluating tactile-enabled robot manipulation across simulation and the real world.1
• OpenViTac organizes contact-rich manipulation into four tactile-relevant capability dimensions and provides paired simulation-real-world settings for consistent evaluation of VLA, WAM, and VTLA policies.1
• Correspondingly, we introduce OpenVTLA, a tactile augmentation framework that combines the best-performing representation and integration strategy.1

Sources (1)

• [1]OpenViTac: Learning and Benchmarking Visuo-Tactile Policies in a Unified Sim-and-Real Framework
  arXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 7, 04:43 PM

  To address this gap, we introduce OpenViTac, a visuo-tactile manipulation benchmark for evaluating robot policies across simulation and the real world.

  Tactile feedback provides embodied agents with physical information beyond visual observations, enabling more reliable interaction with the real world.

Extractive summary: sentences quoted from the sources.