Trained a 1.57B-parameter Dreamer 4 World Model from scratch for under $150
OtherRaisin3426 · reddit · 2026-08-24
The author shares the experience of training a 1.57B-parameter Dreamer 4 world model from scratch for under $150. Building on Genie's architecture, the project fixed control issues found in the initial attempt. Key takeaways include:
- Cost-effective: A $150 budget is sufficient to train such models, removing the need for frontier lab resources.
- Data Strategy: Instead of scraping video, every frame was generated using Procgen, ensuring access to true action labels at every step to verify the model's responsiveness.
The final model achieved 40.41 PSNR and 32.19 FVD on CoinRun, remaining stable for 144 frames. A demo and code are provided.
More from Research
- Pathway CSO pitches BDH as post-Transformer architecture uniting memory, reasoning, adaptation — schwentker · 2026-10-15
- EmbodiedEvo tops RoboDojo at 38.95% success by letting robots inherit failed practice — thetripathi58 · 2026-10-15
- 797GB of n-gram counts in CPU RAM let 1B models match 57% more compute — PangWeiKoh · 2026-10-15
- Google's HARNESS² evolves agent harnesses without verifiers, up to +11.5 points on WorkBuddy-Bench — dair_ai · 2026-10-15
- Subbarao Kambhampati to dissect the 'mythos of LLM thinking tokens' at UMN — rao2z · 2026-10-15
- How 3D Gaussian Splatting gives robots spatial memory of what's out of view — TheTuringPost · 2026-10-15