Gemini Robotics ER 2 in Action: Sub-second Bidirectional Streaming & Multi-Robot Orchestration
_philschmid · x · 2026-07-30
Prominent AI developer Phil Schmid detailed the breakthrough capabilities of Gemini Robotics ER 2. The model outperforms competing frontier models in embodied reasoning, with a core advantage being its ability to think and plan next steps simultaneously while executing current actions.
Key technical highlights include:
- Live API support for bidirectional, sub-second robot streaming.
- 91.3% moment-finding accuracy at 4x faster execution speed.
- 57.4% accuracy tracking 5-stage task progress on video feeds.
- Allows multi-robot orchestration and handoffs between different machines.
- Built upon Gemini 3.5 Flash.
Demonstration videos show that the Boston Dynamics Spot robot integrated with this API completes tasks without the awkward freezes seen previously, resulting in highly fluid movements.
More from coding & agent
- 'LLM code is sloppy' rebutted with real ffmpeg code: identical if/else branches in a top library — kingslyj · 2026-10-16
- Agent actions need checks outside the model: NVIDIA demos lean on guardrails amid wave of real agent incidents — Creamy-And-Crowded · 2026-10-16
- Vitalik builds "paranoid mode" agent wrapper with Tor, zkAPI and local prompt rewriting — DavideCrapis · 2026-10-16
- Agent fine-tunes Qwen3.5-0.8B with synthetic data: 4.7%→76.3% accuracy, 11.9× faster — ben_burtenshaw · 2026-10-16
- Beam-501B agent demo: solo beats 5-agent team on ProgramBench rebuild task — ben_burtenshaw · 2026-10-16
- Beam agent builds BeamSpeak, a local Parakeet dictation app for macOS — ben_burtenshaw · 2026-10-16