Astra vs. Fable 5.1 on Real ML Tasks: Astra More Agentic, Fable Writes Better
burkov · x · 2026-09-08
Andriy Burkov compared Astra and Fable 5.1 on real machine learning tasks.
- Takeaway: Astra codes more agentically and showed noticeably stronger scientific rigor and reproducibility; Fable writes better and follows directions more coherently, while Astra's final outcomes were slightly better.
- Key numbers: Both models improved F1/Accuracy by 0.02-0.04 after human feedback on their approach, suggesting neither has fully mastered AI/ML text processing, vectorization, and model training pipelines.
- Full comparison available at the linked post.
More from Models
- Sander Dieleman on Diffusion Models, Typicality, and Why ML Breakthroughs Are Closer Than They Look — sedielem · 2026-09-08
- Astra on low reasoning beats Sol on high, and runs twice as fast, devs confirm — steipete · 2026-09-08
- Astra Driving Blender via Computer Use Could Be AI's Fourth Demand Wave — firstadopter · 2026-09-08
- GPT-6 Astra Tops Blueprint-Bench 2, Nearing Human 3D Spatial Understanding — steipete · 2026-09-08
- Same $10/$50 price tag, very different bills: Astra vs Fable 5.1 token efficiency and cache economics — nearsync43 · 2026-09-08
- davinci-002 shutting down September 28, ending the GPT-3 era — altryne · 2026-09-08