Runway unveils Solaris: The first Interface World Model
机器之心 · wechat · 2026-09-01
Runway introduced Solaris, defined as the first "Interface World Model." Instead of generating code for interfaces, it uses a model to directly generate the next visual frame in real-time based on user interactions (clicks, drags), making the visual itself the software.
Core Mechanics:
- Built on Gen-4.5, it conditions generation on user inputs to predict visual states post-action.
- Achieved real-time speeds via autoregressive generation and distillation of denoising steps.
- Architecture separates the LLM (reasoning/decision) from the World Model (rendering).
Experimental Results:
- Direct visual generation results in less information loss for complex interfaces compared to the "code-to-render" pipeline.
- In 7,500 human comparisons across 30 cases, Solaris significantly outperformed code-based solutions in following instructions and natural behavior.
Applications:
Beyond UI generation, Solaris aims to serve as a training environment for Computer Use Agents. By generating infinitely varying interface layouts, it forces agents to learn general interaction logic rather than memorizing specific button positions.
Related event: Runway Unveils Solaris, Its First Interface World Model(8 posts)→
More from Multimodal
- Fan Uses Grok Imagine to Recreate Laertes Scene Cut From Nolan's Odyssey — sachinmaya1980 · 2026-09-01
- Redditor revives the Nicolas Cage Superman in a spot-on 10-second AI video — Sad_Coach_1433 · 2026-09-01
- Fictional motion graphics ads created with MiniMax H3 Max — Hailuo_AI · 2026-09-01
- Grok Bot now natively integrates image generation — XFreeze · 2026-09-01
- Midjourney Prompt Recreates Direct Flash Morning Portrait — tisch_eins · 2026-09-01
- MiniMax H3 Workflow Creates Interactive 360° Immersive Worlds — listopalafoto · 2026-09-01