Spiral open-sources t4, a Rust object store cache that queries disk at memory speed
sh_reya · x · 2026-11-20
SpiralDB released t4, an Apache-2.0 embedded object store cache in Rust aiming to "query disk at memory speed." It auto-handles prefetching, splitting, coalescing and racing reads, offers custom cache policies, hybrid memory/disk/remote tiers with multi-device striping, and uses iouring while staying async-runtime-agnostic. A single read can be split across memory, NVMe SSDs, and S3 into one buffer, with Direct I/O bypassing page cache and CPU copies. The authors warn it has higher ceilings but requires more understanding to use well.
More from Infra
- Anthropic would need $602B annual revenue—17x growth—to match tech peers' returns — GaryMarcus · 2026-11-20
- Cost chart: Claude Fable 5.2 burns $54 per task, OpenAI a fraction — haider1 · 2026-11-20
- Anthropic reportedly migrated to AMD GPUs in 3 days, vs 6-12 months previously — AccBalanced · 2026-11-20
- GPU shortage's flip side: rented GPUs sit idle, and scheduling startups see an opening — AccBalanced · 2026-11-20
- Quantum computing buzz at SC: author ran an X gate on a real QPU, 3-5 years to commercial use — StasBekman · 2026-11-20
- Orbital's Agentic OS Designs First PFAS-Free Two-Phase GPU Cooling Fluid — enjalot · 2026-11-20