Short RL phase on GLM 5.3 Flash costs $372 vs $1,894 for notes, breaks even in 8.7 days
teortaxesTex · x · 2026-11-05
EngramLab shared a real cost experiment: a short RL phase fine-tuned GLM 5.3 Flash to actively use its notes instead of stuffing them into context.
Key numbers:
- Generating the notes cost $1,894.49 in inference, while the follow-up RL training cost only $372.57;
- Per the cumulative cost curve, the training route breaks even with the notes-in-context route after about 8.7 days / 3,487 queries, then stays 5-10x cheaper.
The takeaway: with good infrastructure, replacing long-context inference overhead with training is surprisingly cost-effective — "training is just inference with a backwards pass." A concrete, replicable cost accounting for anyone designing agent memory or knowledge workflows.
Related event: Engram: $373 RL run teaches models to use their notes(7 posts)→
More from coding & agent
- Revolut cut AI coding inference costs ~90% by self-hosting GLM on 56 B200s instead of Claude — sebkrier · 2026-11-05
- VibeCoding a 3D fishing game in 4 days with Kimi K3.1 Pro and DeepSeek: full workflow breakdown — lxfater · 2026-11-05
- Sentry founder says AI agent 'junior' handles hardest coding tasks well — zeeg · 2026-11-05
- How Codex Happened: Inside OpenAI's coding comeback from failed launch to ChatGPT centerpiece — danshipper · 2026-11-05
- Tencent Hunyuan Hy4 lands in OpenClaw with vision, 1M-token context, agent gains — TencentHunyuan · 2026-11-05
- Dev shows Claude Code workflow that builds sites with no obvious 'AI slop' — randomname11111_ · 2026-11-05