Open-AoE opens 2,000 hours of egocentric manipulation video for robot learning
inclusionAI · hf · 2026-07-21
Open-AoE releases an open egocentric manipulation dataset and toolchain
Open-AoE is a community-oriented dataset and toolchain for embodied learning that covers the full pipeline from smartphone capture to model training.
- Scale: about 2,000 hours of manipulation video
- Collection: gathered in natural environments by 500+ contributors using 400+ smartphones
- Annotations: text labels, MANO-based hand poses, camera trajectories, and temporally localized atomic actions
- Pipeline: temporal action segmentation, semantic annotation, hand reconstruction, and camera trajectory reconstruction
- Toolchain: visualization, cross-embodiment retargeting, model-specific data conversion, and training recipes for VLA policies, WAMs, and World Models
The project aims to lower the barrier for data contribution and reuse in human-to-robot transfer and world modeling.
More from Embodied
- Claude Code finds root backdoor in Honda Civic head unit, then debloats it — IndraVahan · 2026-10-26
- Temple health wearable opens pre-orders, users ask: why wear it before benefits are proven — abhishekcode42 · 2026-10-26
- FLASH: GPU-native deformable sim learns cloth folding in minutes on one RTX 5090 — ChongZzZhang · 2026-10-26
- Luke Wroblewski spots it: iPhone Duo's corner radius mirrors the original iPhone — LukeW · 2026-10-26
- Humanoids shattered forecasts: half-marathon record in 2026, 100m faster than Bolt — ben_j_todd · 2026-10-26
- Humanoid walking is continuous correction — watch recovery, not locomotion, in demos — Olivier__OG · 2026-10-26