Toloka Train Cuts AI Costs Up to 37x with Fine-Tuning and Gisting
MParakhin · x · 2026-08-26
Toloka launched Toloka Train, offering Fine-tuning and Prompt Gisting tools to lower AI request costs. The Fine-tuning feature trains LoRA adapters on top of a frozen Qwen3 base (4B–235B), allowing users to replace expensive frontier models with smaller open models.
Key Case Study:
- Use Case: CV parsing pipeline.
- Results: Inference costs reduced by 12–37x (from $10–$30 per 1k CVs to $0.80); F1 score improved from 0.85 to 0.94 (beating the latest frontier model's 0.93).
- Workflow: End-to-end deployment in a few days.
This approach shifts variable per-token spend to fixed, predictable compute, achieving over 100% price-performance improvement.
More from Infra
- Selling B300 inference nets $40/hr vs $6/hr rental — but the math is disputed — TheZachMueller · 2026-10-15
- ASML CFO says US Match Act restricting DUV sales to China would backfire — pstAsiatech · 2026-10-15
- ASML sold out through 2028 but stock dips 2%; TL20 index up 57% YTD — TiernanRayTech · 2026-10-15
- Bloomberg breakdown: a 1GW Texas AI data center may need nearly $3B for overruns alone — rohanpaul_ai · 2026-10-15
- 7 System Design Algorithms to Know: Merkle Trees to CAP/PACELC — goyalshaliniuk · 2026-10-15
- MiniCPM-V 4.7 runs a 35B MoE multimodal model on phones with just 3GB memory — nevrekaraishwa2 · 2026-10-15