Mooncake author presents fleet-wide elastic KV cache across Cloudflare on Kastan Day
michellechen · x · 2026-11-05
On "Kastan Day," Cloudflare's talk "Every Spare Gigabyte: A Fleet-Wide Elastic Mooncake Cache" — by Mooncake's creator Kastan Day — explains how spare RAM and SSDs across a fleet can be pooled into a shared KV cache that elastically scales with model demand.
More from Infra
- 'Joules-to-GDP' framework: the highest-value AI tasks aren't the most energy-efficient — arena · 2026-11-05
- Dev speeds up Meta's Muse Glimmer 30B by up to 21% on Mac Studio, catches its 10 cheats — TimDarcet · 2026-11-05
- Mach 2 Medium sets new Pareto frontier for Qwen 3.8 compression: 1.5% loss at 26.7GB, beating Unsloth — pbaylies · 2026-11-05
- Redditor finds Tiel-Coder-35B MoE runs faster than Qwen 3.8 locally with 256K context — zxspectrun · 2026-11-05
- 63% of planned US data centers sit in states whose governors pledged bans or pauses — Catholic_Indian10 · 2026-11-05
- OpenAI's Stargate to consume up to 40% of global DRAM output via Samsung/SK hynix deal — TheZachMueller · 2026-11-05