Skywork open-sources Matrix-Game 4.0, a game world model that runs on a single RTX 5090

量子位 · wechat · 2026-10-15

Skywork AI (Kunlun Wanwei) released and open-sourced Matrix-Game 4.0, billed as the first game world model that runs in real time on a single consumer GPU.

Key idea: engine runs the rules, video model paints the world

Unlike Google's Genie line where the video model implicitly memorizes the world, the team argues rule drift is worse than visual glitches. A coding agent turns natural language into game code, a game engine maintains world state and draws a structural sketch, and the video model fills in materials and lighting in real time.
In the demo, shield durability, health, and win/lose conditions are all settled by code; rules can even be rewritten via natural language (e.g., a time trial becomes a pursuit mission).

How it fits on one card

Paired UE5 training data (structural + final frames) plus dynamic captions tell the model what to draw.
V2V model built on Wan2.2 5B Fun Control, with spatial memory references, first-frame linking, and recent-history caching.
Few-step autoregressive distillation down to 1-2 denoising steps, four frames at a time, plus CUDA Graphs, FP8 fused kernels, and a KV ring buffer.
Steady-state 83FPS at one denoising step, 60FPS gameplay, 112ms key-to-frame latency—versus NVIDIA's similar StreamRender-H3 on 8x GB200 at 545ms.

Resolution is still 480p, but the team has open-sourced every version since 1.0, betting the community will sort out a field where technical approaches haven't converged.

Original post →

Skywork open-sources Matrix-Game 4.0, a game world model that runs on a single RTX 5090

More from Models