Sampler Pause Stays Under a Second Even Across Distant Datacenters
gharik · x · 2026-11-03
Asked whether sampler pause time stays under a second when datacenters are far apart, @gharik relays @zianglih's answer: the pause only covers decompression and patching with a native decompression ASIC, overlapped with local GPU work, so cross-datacenter latency does not affect it.
Related event: Weight Teleportation Open-Sourced: Cross-Datacenter RL Weight Sync in 0.23s(8 posts)→
More from Infra
- Trainium3 Tested: 30.47% MFU on Qwen3-32B, but GPT-OSS Compiles 27 Minutes Before Step One — demian_ai · 2026-11-03
- Default AI agents to serverless, then let production data decide what moves — rseroter · 2026-11-03
- Anthropic's compute bill nearly quintupled in a year as financing costs climb — GaryMarcus · 2026-11-03
- Do faster quantized LLMs (Basalt, Infernix, Strata-nvfp4) trade away quality? — Kooky-Mode3047 · 2026-11-03
- Gratis launches: run open-source AI models locally in your browser with zero setup — markjeffrey · 2026-11-03
- SPC NYC hosts stacked panel on compute trading with Jump Trading and Cantor leads — ditzikow · 2026-11-03