Astra vs Fable 5.1 on real ML tasks: rigorous vs readable, with a mojibake twist
returnity · reddit · 2026-09-06
A developer ran a side-by-side comparison of Astra and Fable 5.1 (both xhigh) on a real ML text-processing and model-training workflow.
TL;DR: Astra codes more agentically, Fable more coherently. Astra's final outcome was slightly better with noticeably stronger scientific rigor and reproducibility; both improved F1/Accuracy by 0.02-0.04 after human feedback, showing neither has mastered the pipeline.
Astra's strengths:
- Stricter evaluation protocol (70/15/15 split with held-out validation model selection vs Fable's 80/20 + test F1).
- Hit a gensim 4.4 compiled-kernel bug: Fable hid the stderr notices; Astra root-caused it and fixed the environment with a compatible gensim/NumPy/SciPy downgrade.
- Wrote hardened training code: isolated uv venv rebuild, SHA-256'd corpus, split manifest, run-summary., even headless-browser QA screenshots.
- Deployed subagents effectively; the notebook-reviewer caught a real tokenization bug and left a regression test.
Fable 5.1's comeback:
- Astra confidently shipped a verifiable encoding defect, decoding UTF-8 as Windows-1252 and producing mojibake in currency symbols; Fable verified UTF-8 and got it right.
- Fable's analysis report was more insightful, running an ablation that surfaced an expensive no-op preprocessing step.
- More idiomatic, readable code that better followed coding-conventions.md, and better scoping. The author now picks Fable 5.1 for prose—something they hadn't said about Claude in a while.
Related event: Astra vs Fable 5.1: One Rigorous Engineer, One Better Writer(2 posts)→
More from Models
- Astra review: executes hour-long agentic tasks while iterating on the plan without losing the thread — ivan_bezdomny · 2026-09-06
- "I love the way Astra talks": users praise its simple, structured output style — johnlindquist · 2026-09-06
- $1,000-trained HRM-Text shows Sapient bet on recurrence before OpenAI's Astra — rohanpaul_ai · 2026-09-06
- Entropy trajectory shape predicts Qwen3-4B errors and transfers to unseen tasks — Happy_Brilliant7827 · 2026-09-06
- Making GPT-6 Astra hand-draw an SVG cottage: 4 image-gen cheats, then real vectors — mvandemar · 2026-09-06
- ChatGPT 5x Pro User Can't Find Any Way to Access Astra Outside Codex CLI — Virtual_Plant_5629 · 2026-09-06