Patch Policy preserves dense spatial detail for robot manipulation
chris_j_paxton · x · 2026-07-23
Patch Policy keeps spatial detail for robot control
The paper argues that visuomotor policies often lose the fine-grained spatial information needed for manipulation. Its answer is to keep dense patch features from a ViT instead of pooling everything into a single vector or training a vision backbone from scratch.
Main idea
- Encode multi-view observations as dense patch tokens.
- Optionally concatenate goal image or goal vector embeddings.
- Use a block-causal attention mask: full attention within each frame, causal masking across frames.
- Predict actions from the last patch token of each frame.
Why it matters
- Preserves spatial detail for precise manipulation.
- Keeps the benefits of large-scale visual pretraining.
- Stays compatible with standard transformer policy heads.
The image also shows the method evaluated with state-of-the-art policy heads, and the paper claims strong recovery of specialist scores while keeping inference practical for reactive control.
Related event: Patch Policy Outperforms 7B VLA with 0.7% Parameters(5 posts)→
More from Embodied
- Amazon and Google sold 600M+ smart speakers, so why no AGI-era successor? — julianlehr · 2026-09-11
- ECCV26 Oral: Flow Matching Enables Single-Stage Multi-View Point Cloud Registration — ducha_aiki · 2026-09-11
- Polish developers build iPhone app that detects nearby Meta smart glasses — Low-Honeydew6483 · 2026-09-11
- Ant's Afu health AI hits 150M users, unveils AI+hardware health alliance at Bund Summit — APPSO · 2026-09-11
- Johns Hopkins Launches Full-Stack Hands-on Robot Learning Class with SO-101 Arm Kits — _krishna_murthy · 2026-09-11
- SyncWorld: In-Context Robot World Model Simulates Unseen Views and Embodiments Zero-Shot — ChongZzZhang · 2026-09-11