NVIDIA's Online Draft Co-Training Speeds Speculative Decoding in Long-Context RL Post-Training
nvidia · hf · 2026-09-09
NVIDIA published Online Draft Co-Training for Speculative Decoding, targeting inference acceleration for large-scale, long-context RL post-training.
Technical highlights:
- Online co-training of draft models to accelerate speculative decoding
- Extends context-parallel attention
- Adds cross-stage feature transport
Addresses generation throughput bottlenecks in RL post-training, especially for long contexts.
More from Infra
- Engineer with thousands of fabricated devices pours cold water on photonic crystal modulator yields — jwt0625 · 2026-10-26
- Anthropic S-1 reveals 48 cents of compute cost per dollar of Q2 revenue — nmasc_ · 2026-10-26
- Persistent AI joins UR network to route private AI inference with encrypted, IP-hidden traffic — 0xSammy · 2026-10-26
- Anthropic's disclosed compute commitments: $114.5B Google, $161.2B Broadcom top the list — BenBajarin · 2026-10-26
- SpaceX strikes $40B deal with Apollo Global to lease AI chips and data center hardware — Polymarket · 2026-10-26
- SpaceX AI revenue up 830%, Claude designs 318K antivenom proteins in 64 hours — PeterDiamandis · 2026-10-26