Skywork's Matrix-Game 4.0 runs AI-generated games at 60FPS on a single RTX 5090, open-sourced
机器之心 · wechat · 2026-10-15
Kunlun Tech's Skywork released and open-sourced Matrix-Game 4.0, claiming the first video-model game running in real time on a consumer GPU: built on Wan2.2 5B, it hits 480p at 60FPS on a single RTX 5090 with under 150ms keypress-to-frame latency, 83FPS steady-state generation, and 18.5GiB peak VRAM—versus NVIDIA's StreamRender-H3, which needs 8x GB200s and 500ms latency. Model weights and modifiable game code are both open.
- Harness architecture: a game engine maintains rules and state (games written by a coding agent; changing gameplay means editing code, no retraining), a coding agent handles visual style and improvisation, and the video model only renders—barred from touching core game data.
- Training: pixel-aligned UE5 structural-frame-to-render dataset; dynamic captions that update with the player's view; a 148-channel video-to-video model trained with SFT then causal-forcing into an autoregressive few-step generator.
- Inference: CUDA Graph replay, fused RoPE/norm/FP8 kernels, ring KV cache, text-KV reuse, and a lightweight TAEHV codec squeeze the text encoder, 30-layer DiT, and VAE onto one 5090.
The piece also traces Matrix 1.0→4.0 evolution and why implicit-memory world models like Genie 3 drift over time.
More from Multimodal
- Open-source LoRA turns MiniMax H3 into seamless 360-degree orbit videos from a single photo — camenduru · 2026-10-15
- Neon Noir Elegance prompt template goes viral with striking pink-blue two-tone outputs — LudovicCreator · 2026-10-15
- Krea 2 Turbo + px16 LoRA generates game-ready pixel art in 5s, where GPT Image 2.5 fails — Angaisb_ · 2026-10-15
- How Goldfish Made Its Kung Fu Scenes: Real Nanquan Choreography + Seedance 2.5 — JunieLauX · 2026-10-15
- Prompt share: 'Crimson Footsteps' makes one red element pop in monochrome AI photos — azed_ai · 2026-10-15
- Magnific One generates fake Zhangjiajie tourist photos indistinguishable from real shots — techhalla · 2026-10-15