Trained a 1.57B-parameter Dreamer 4 World Model from scratch for under $150
OtherRaisin3426 · reddit · 2026-08-24
The author shares the experience of training a 1.57B-parameter Dreamer 4 world model from scratch for under $150. Building on Genie's architecture, the project fixed control issues found in the initial attempt. Key takeaways include:
- Cost-effective: A $150 budget is sufficient to train such models, removing the need for frontier lab resources.
- Data Strategy: Instead of scraping video, every frame was generated using Procgen, ensuring access to true action labels at every step to verify the model's responsiveness.
The final model achieved 40.41 PSNR and 32.19 FVD on CoinRun, remaining stable for 144 frames. A demo and code are provided.
More from Research
- "Model Organisms of Misalignment": a proposed new pillar of alignment research — CFGeek · 2026-08-24
- SweetFold Diffusion Model Tackles the Nightmare of Glycan Structure Prediction — AllThingsApx · 2026-08-24
- HydroGym Cuts Training Iterations by 65% with Gradient-Enhanced PPO — maier_ak · 2026-08-24
- RL Agents Cut Wing Drag by 38% via Zero-Shot Transfer — maier_ak · 2026-08-24
- IJCV Special Issue Call for Papers: Multimodal Unified Comprehension and Generation (MUCG) — liuziwei7 · 2026-08-24
- Researcher Shashwat Goel to visit Google for LM forecasting work — dpaleka · 2026-08-24