celld v0.3.0's replicated write-behind log cuts S3 costs from $600k to $4k/month
andersonbcdefg · x · 2026-08-21
Developer roughsea released celld v0.3.0, introducing a replicated write-behind log — hopefully the last major architecture change. The goal is scaling to a Discord-sized site where every channel is a cell, an estimated 4B messages/day.
Previously celld wrote to S3 per message (46k PUTs/sec, $600k/month in write ops alone). The new version buffers before sending to object storage, cutting it to 300 PUTs/sec ($4k/month). Durability isn't weakened: writes aren't ack'd until persisted on three disks, and crashes during the buffer window can recover from peers, achieving RPO=0 and surviving the loss of an availability zone.
More from Infra
- Muse Spark Open runs locally on a Mac M3 Ultra via llama.cpp: frontier model on desktop — pcuenq · 2026-10-16
- Muse-Spark open-weights drop: 816B-A42B MoE model gets 359GB MLX 3-bit build — ns123abc · 2026-10-16
- vLLM ships Day-0 LoRA RL for Muse Spark Open, lifting AIME from 0.56 to 0.85 — vllm_project · 2026-10-16
- DSpark draft model for Muse Spark Open proposes 7 tokens per pass with 23-42% acceptance — vllm_project · 2026-10-16
- Cloudflare Stream's WebRTC ultra-low-latency live streaming is now Generally Available — ritakozlov · 2026-10-16
- YC-backed Overshoot launches inference optimization, claims $5M saved for AI teams — ycombinator · 2026-10-16