Google's Genie 4 goes live on Gemini API: steerable 720p worlds via WebRTC

_philschmid · x · 2026-11-20

Google has rolled out Genie 4 on the Gemini API and AI Studio. The world model seeds a 720p 24fps interactive world from text or an image, which you can steer live with WASD keys, prompts, and 48 kHz stereo audio.

Streaming works via WebRTC (browser, with ephemeral auth tokens so the API key never leaves your server) or WebSocket in Python and JS. The sample code shows the full flow: mint a token server-side, connect the client, seed the world with a worldsetup event, then send useraction events for live steering and call complete() to end billing.

Original post →

More from Models

Models channel →