2,500 Concurrent Sandboxes Per Node, Cross-Scaffold Checkpoint Merging Yield Free Gains
nrehiew_ · x · 2026-09-11
nrehiew explains the sandbox infra: a custom orchestrator places sandboxes across compute nodes with local bottleneck checks, each VM in a NUMA domain supports 2,500 concurrent sandboxes with priority scheduling, and hacking triggers a "repercussion" signal. Agent trajectories are for the first time explicitly inspired by real-world partner usage patterns, and merging checkpoints across different scaffolds and configs delivered free performance gains.
Related event: Leaked DeepSeek V4.1 Flash Tech Report Reveals KV Cache-Obsessed Flagship(44 posts)→
More from Infra
- Open-source Latch compiles PyTorch into training megakernels, 2.75x faster on H100 — sguada · 2026-10-27
- DeepSpeed shows AutoEP/AutoTP/AutoSP parallelism gains, hosts office hours — PyTorch · 2026-10-27
- Running a local 9B as a coding agent: brief the big model to plan, let the small model execute — Electrical_Ninja3805 · 2026-10-27
- Cloudflare Durable Objects validated as top architecture for AI agent WebSocket servers — tristanbob · 2026-10-27
- Gary Marcus: With Q3 data added, Anthropic's compute-efficiency growth shows deceleration — GaryMarcus · 2026-10-27
- SpaceX locks in $40B GPU financing deal with Apollo, the largest ever committed — TechCrunch AI · 2026-10-27