Open-source video-to-game: agent rebuilds 31 playable games from clips, ~$6 each
songguoxiansen · x · 2026-11-09
The open-source lovisdotio/video-to-game (551 stars) is a skill for coding agents: it decomposes a gameplay video shot by shot — camera, characters, colors, core mechanic — then generates every image, 3D model and sound via the fal API, writes the game in Three.js as a single index.html, and even plays it with the keyboard and films its best seconds as proof. Works with Claude Code, Codex, Cursor, Gemini and others.
The division of labor is notable: the video model handles "what the game should look like," while the agent adds controls, rules and the game loop — the video effectively becomes a frame-by-frame design doc.
The repo ships 31 original games, each rebuilt from a 10–15s clip (generated with MiniMax H3 Max), totaling 1,013 fal calls (594 images, 194 3D models, 290 sounds/music tracks) for $202 — about $6 per game.
More from coding & agent
- Garry Tan: Apple should rebuild its software teams with hundreds of codegen agents — illscience · 2026-11-09
- Why top coding models without dedicated s-tier harnesses go untested: the harness-model pairing effect — illscience · 2026-11-09
- WonderDuck: open-source robot duck ships full sim-to-real pipeline — philfung · 2026-11-09
- AI Engineer Code Summit kicks off in SF with agent-heavy agenda — threepointone · 2026-11-09
- Agent Security Incidents Need Tamper-Proof Audit Trails, Khala Research Report Argues — 0xSammy · 2026-11-09
- SenseTime open-senses Code2Video: an open model that makes editable videos via code — HeyZoyaKhan · 2026-11-09