Making coffee with head-mounted cameras: egocentric data capture for humanoid robot training
jonstephens85 · x · 2026-09-26
At Humanoids Summit, the author tried LightwheelAI's egocentric data capture system: head-mounted cameras plus wrist cameras recording human interaction from a first-person perspective.
- A simple task like making coffee becomes dozens of sub-actions for a robot: grab the cup, place it, pick up the pod, open the machine, insert the pod, close it, press the button
- Capturing and annotating these human demonstrations is a key way to create training data for robots learning longer-horizon real-world tasks
- Wearing all the gear while making coffee is admittedly awkward
More from Embodied
- German startup ecoro pilots fully autonomous inter-building cargo system in Japan — 4310sy · 2026-09-26
- Reachy Pilot links SPECS smart glasses to a Reachy Mini robot for remote guarding — Scobleizer · 2026-09-26
- ProxyPose lands at NeurIPS: track 6-DoF pose from a single query pixel — CSProfKGD · 2026-09-26
- Using ChatGPT Voice to query pesticide records: it reads and updates Airtable hands-free — athyuttamre · 2026-09-26
- Vibe-coding hardware: build an ESP32 e-ink dashboard with Codex and Cloudflare — paw_lean · 2026-09-26
- Niantic opens Places Library: 100 real-world 3D scenes for embodied AI training — Scobleizer · 2026-09-26