Dev turns Runway AI video into a playable Unreal Engine game via agent

davidfromkansas · x · 2026-11-07

Using RunwayML's video model to generate sample gameplay footage, the author then fed the clip to an agent that built a playable game in Unreal Engine.

What impressed him most: the AI treated the video's frames as a visual target, iteratively refining the gameplay to get closer to the original footage. The result still needs polish, but the pipeline — generated reference video → agent recreates it as a playable game — actually works, pointing to a novel way to prototype games.

Original post →

More from coding & agent

coding & agent channel →