Open-source video-to-game skill turns one gameplay clip into a playable Three.js game for ~$6

OdinLovis · x · 2026-11-09

lovisdotio released video-to-game, an MIT-licensed skill (555 GitHub stars) that teaches coding agents like Claude Code, Codex, Cursor and Gemini to turn a gameplay video into a real browser-playable game.

A video model designs the game's look, camera and one memorable mechanic; the agent studies the clip frame by frame, generates all images, 3D models and sounds via fal, writes the game in Three.js as a single index.html (no engine), then plays it with the keyboard and films its best seconds as proof.
31 original games were rebuilt from 10-15s videos generated with MiniMax H3 Max on fal: 1,013 fal calls (594 images, 194 3D models, 290 sounds/music), $202 total — about $6 per game. All playable at fal-video-to-game.vercel.app.
Core idea: references are the cheat code for AI media generation — define art direction, mechanics, HUD and assets up front instead of prompting and praying.

Original post →

Open-source video-to-game skill turns one gameplay clip into a playable Three.js game for ~$6

More from coding & agent