PACE: Stage-Consistent Long-Horizon Robot Manipulation via Progress-Aligned Context for Execution

Key points

• We identify the resulting failure mode as stage confusion and introduce Progress-Aligned Context for Execution (PACE), a stateful method that continually reinterprets a complete demonstration according to realized execution progress.1
• PACE compresses the demonstration into ordered multimodal prompt tokens and uses training-only dual-edge attention supervision to expose its latent stage structure.1
• During execution, an episode-local fast-weight memory causally encodes realized action-observation transitions and modulates prompt cross-attention, producing a progress-aligned context for a unified diffusion action expert without test-time stage labels or stage-specific policies.1
• Failure analysis further indicates that structured demonstration alignment and causal execution memory jointly mitigate stage confusion.1

Sources (1)

• [1]PACE: Stage-Consistent Long-Horizon Robot Manipulation via Progress-Aligned Context for Execution
  arXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 6, 07:58 AM

  Demonstration-conditioned policies provide a natural interface for specifying robot behavior, yet long-horizon manipulation remains difficult when visually similar states recur across different stages or when demonstrations and executions proceed at different speeds.

  We identify the resulting failure mode as stage confusion and introduce Progress-Aligned Context for Execution (PACE), a stateful method that continually reinterprets a complete demonstration according to realized execution progress.

Extractive summary: sentences quoted from the sources.