PixVerse R2 turns AI video into a real-time playable world model with persistent memory
LearnWithBishal · x · 2026-09-26
PixVerse R2 makes AI video interactive: you steer the world with WASD keys or prompts in real time. Instead of chaining clips, it runs a continuous world-state — a causal autoregressive backbone with three memory channels (Sink Memory for persistent identity and rules, Rolling History for recent dynamics, and a compressed Object KV Cache), essentially streaming video with persistent memory.
It also collapses the typical 5+ training stages into two — an Omni Causal AR "world brain" plus ultra-few-step distillation for real-time speed — reaching 90%+ attention sparsity without visual quality loss. An "ERROR BANK" stores failure states and replays them during training, cutting long-horizon drift by 35.8% in internal tests, so the world gets better the longer you play.
More from Multimodal
- Blender agents meet fal's H3 Max: 3D previs turns into photoreal video — gorkem · 2026-09-26
- A short film 'From Rocks to AI' made entirely with Claude Opus 5.5 — coherence · 2026-09-26
- CMU and Meta Unveil TrackEverything, a 3D Point Tracker for 1000+ Frame Long Videos — AdamWHarley · 2026-09-26
- Casual Snapshot Realism LoRA released for Qwen 2.1 with full ComfyUI workflow — kosovack · 2026-09-26
- Qwen-Image 2.1 turbo distill matches base quality in 6 steps — init-5 · 2026-09-26
- Google ships Gemini 3.8 Flash TTS, Live Avatar, and plans to test TPUs in orbit — GoogleAI · 2026-09-26