Xiaohongshu open-sources REDOHC: 3.38x read throughput over Cassandra OHC, near-zero GC
小红书技术REDtech · wechat · 2026-10-09
Xiaohongshu's search/ads team open-sourced REDOHC (Apache 2.0), a Java off-heap cache engine powering recall paths serving tens of millions of lookups per second.
- Benchmarks vs Cassandra OHC: 3.38x throughput at 32-thread pure reads, 2.60x at 9:1 read/write; 0.001B heap allocation per read and zero GC vs 32B/op and 22 GCs.
- Architecture: lock-free reads, write-path arena allocation with atomic publish, and a single-threaded background actor handling eviction, TTL, reclamation and page returns asynchronously.
- Details include 64-byte cache-line alignment, hierarchical timer wheels for O(1) TTL, S3-FIFO eviction, and AI-assisted JIT machine-code analysis; RSS falls from 8.5GB to 51MB in 10 seconds after load.
More from Infra
- OpenJet claims Qwen3.8-27B coding runs 1.9x faster than llama.cpp on one RTX 3090 — JeremyCMorgan · 2026-10-23
- Jensen Huang lays out NVIDIA's full Vera Rubin agentic system: NVL72, MGX, CMX and RTX — rohanpaul_ai · 2026-10-23
- Jensen Huang details Vera Rubin agentic stack: NVL72, MGX, CMX and RTX — rohanpaul_ai · 2026-10-23
- ONNX to Transformers.js: running models directly in your browser — JosephJacks_ · 2026-10-23
- MiniMax M3.1 Flash free for 3 days on 0G, with 1M context and 512K output — MiniMax_AI · 2026-10-23
- "We bet on Cloudflare and it paid off": R2 and D1 at billion scale — dinasaur_404 · 2026-10-23