Figure's Helix 2.5 hits 56% zero-shot success across 30 unseen homes, vs 9% baseline
APPSO · wechat · 2026-09-18
Figure released Helix 2.5 and ran a zero-shot, blind evaluation in 30 real Bay Area homes it had never seen: 237 of 420 trials succeeded (56%), versus 9% for the same policy without Index pretraining. Robots folded towels, made beds and picked up objects with no on-site data collection or fine-tuning, with self-correction and retries on long tasks.
Key findings
- With half the adaptation data of its predecessor Helix 02, Helix 2.5 matched Helix 02's success rate — which required site-specific data collection.
- Performance scales predictably with pretraining data, like an LLM-style scaling law: doubling Index data lowers action-prediction error, with loss predictable from small-scale runs to within 0.54%.
Index dataset
The Index data app launched August 25: 264K downloads, 108 countries, 44K weekly active creators, 16M+ videos uploaded (peaking at 35 minutes of new video per second, 4.9 years of human work daily). Figure has paid creators $15M and plans $1B+ over the next 12 months to scale data 100x, with five processing stages (screening, anti-cheating, dedup, rebalancing, captioning).
Context and limits
- 1X's Neo ($20K) still relies on VR teleoperators; Tesla's Optimus uses large-scale human teleoperation data.
- Only 3 task types were tested; 10-12 tasks at 80-90% zero-shot success would make home deployment realistic.
- Nscale committed $3.5B (potentially $6B, up to 100K Nvidia Vera Rubin chips by H2 2027) in compute to Figure and took equity.
CEO Brett Adcock called it "the most important project we've ever done," with data and compute as the biggest bottlenecks.
Related event: Figure Unveils Helix 2.5: Zero-Shot Household Work in 30 Unseen Homes(20 posts)→
More from Embodied
- SSAD 2026: VLAs fail on new cameras, CoT doesn't reflect real causes — abursuc · 2026-09-18
- Japan's maritime AI startup Eightnot raises ¥450M in Series A first close — 4310sy · 2026-09-18
- Robot planning heads to closed-loop settings with neural rendering for realistic environments — abursuc · 2026-09-18
- Holgercke Caesar on autonomous driving: scaling laws, end-to-end learning, and the gap — abursuc · 2026-09-18
- Hugging Face co-founder Thom Wolf shows off iterating robot head prototype — Thom_Wolf · 2026-09-18
- Open-source desk robot Sudo launches: self-hosted AI, $0 subscription, 25 founder units — wateriscoding · 2026-09-18