World models share one architecture — the tokenizer is where methods diverge
abursuc · x · 2026-09-17
In an SSAD 2026 lecture, the author breaks down the common architecture of modern world models: a tokenizer that compresses state into representations, and a world model module that predicts next states. The key design divergence is what the tokenizer encodes: frozen visual autoencoders, frozen representation encoders, or joint encoder+predictor training without a decoder — choices that explain the differences between approaches like JEPA-style and diffusion world models.
More from Research
- Asynchronous Flow Map Language Models Generate All Tokens in a Single Forward Pass — kalyan_kpl · 2026-11-02
- NVIDIA's Kumo Is a Family of Four Tabular Foundation Models, Not Just One — pandeyparul · 2026-11-02
- Economist Aaroth: fast agreement dynamics survive without Bayesian updates or accurate priors — Aaroth · 2026-11-02
- ELLIS names 160 new ML Fellows and Scholars for 2025–2026 — JJitsev · 2026-11-02
- Meme turn 50: Aumann's 'Agreeing to Disagree' paper anniversary — Aaroth · 2026-11-02
- Anthropic: analysts unknowingly adopted their agent's secret lean 86% of the time — shoumikgoswami · 2026-11-02