Patch Policy preserves dense spatial detail for robot manipulation
chris_j_paxton · x · 2026-07-23
Patch Policy keeps spatial detail for robot control
The paper argues that visuomotor policies often lose the fine-grained spatial information needed for manipulation. Its answer is to keep dense patch features from a ViT instead of pooling everything into a single vector or training a vision backbone from scratch.
Main idea
- Encode multi-view observations as dense patch tokens.
- Optionally concatenate goal image or goal vector embeddings.
- Use a block-causal attention mask: full attention within each frame, causal masking across frames.
- Predict actions from the last patch token of each frame.
Why it matters
- Preserves spatial detail for precise manipulation.
- Keeps the benefits of large-scale visual pretraining.
- Stays compatible with standard transformer policy heads.
The image also shows the method evaluated with state-of-the-art policy heads, and the paper claims strong recovery of specialist scores while keeping inference practical for reactive control.
Related event: Patch Policy Enhances Robotic Manipulation with Spatial Details(2 posts)→
More from Embodied
- Robotics paper says VLA and world models are not enough for grounded supervision — hbouammar · 2026-07-23
- Tesla Active FSD Subscriptions Surge 56% YoY to 1.48 Million — Polymarket · 2026-07-23
- Travis Kalanick says his eight-year stealth bet is on industrial AI and robotics — a16z · 2026-07-23
- NASA adds $1.2M to Motiv Space Systems’ robot contract — BrettKrieger12 · 2026-07-23
- SIGGRAPH 2026 method turns 3D objects into multi-touch sensors — cholz · 2026-07-23
- Robot “game skins” become real-world wearable armor at REK Tokyo — cixliv · 2026-07-23