Darkbloom says token throughput rose from 2B to 3.8B a day with the same providers
gajesh · x · 2026-07-28
Darkbloom shared a regular product/company update covering the last two weeks of work.
Key points:
- Token throughput rose from 2B/day to 3.8B/day with the same provider count.
- Reliability improved to 98% across the two weeks, with a big reduction in tool-call errors.
- The team shipped continuous batching, replacing the old loading engine and improving prefill speed by 3–4x.
- Other changes include automatic payouts, opt-in fan control, and MTP for Gemma 4.
Looking ahead, the company wants to get more out of existing machines, shift to paged attention + KV quantization, improve clustering, and continue redesigning the brand and changelog. OpenRouter is now a strategic partner, and Darkbloom is moving some provider earnings to paid OpenRouter usage.
More from Companies & People
- Y Combinator opens Fall 2026 applications, with a July 27 deadline — ycombinator · 2026-07-28
- Virtuals Protocol’s Chris Johnson to speak at RareEvo 2026 in Las Vegas — DonJohnsonSays · 2026-07-28
- a16z says AI startups should choose between Lighthouse and Landgrab for enterprise sales — luisdans · 2026-07-28
- Thinky farewell post signals a personnel change around Lilian Weng and Chenglei Si — YifeiZhou02 · 2026-07-28
- Enterprise teams are still spending four years on Java upgrades because current models can’t handle them — curious_vii · 2026-07-28
- Google DeepMind reconstructs Pelé’s lost 1959 goal and opens GNM to developers — plopesresearch · 2026-07-28