TRL v1.13 ships long-context training: 1M+ token sequences on a single 8-GPU H100 node
SergioPaniego · x · 2026-09-13
Hugging Face's TRL v1.13 is out with support for training on sequences beyond 1M tokens, plus a full guide. The motivation: agent sessions accumulate hundreds of thousands of tokens, so models need training on equally long sequences — which don't fit even on 8 GPUs without help. The example trains exactly one million-token sequence per step on a single 8x H100 node, using gradient checkpointing offload from transformers main.
Related event: Hugging Face TRL v1.13 Enables Training on 1M-Token Sequences(2 posts)→
More from Infra
- Would LITE accepting MRVL's merger offer prove its moat was overstated? — BenBajarin · 2026-10-30
- Claymation body horror on 8GB: three wrong settings, not the GPU, made local renders slow — roro9- · 2026-10-30
- durable-object-migrator: zero-downtime exports for Cloudflare Durable Objects — samgoodwin89 · 2026-10-30
- An unnamed firm already runs a fairly scaled dedicated vehicle for compute lending, says analyst — matt_slotnick · 2026-10-30
- GPU break-even throughput vs open-weight token prices up 25-83% since May — bookwormengr · 2026-10-30
- Sam Altman says the chip supply chain's invisible hand is failing — and DRAM is why — SnoozeDoggyDog · 2026-10-30