TRL v1.15: new Triton kernel scales SFT/RL past 100k tokens on one GPU

_lewtun · x · 2026-10-11

Hugging Face's Lewis Tunstall urges TRL users to upgrade to v1.15: a new Triton kernel scales SFT/RL training to over 100k tokens on the same GPU, a significant boost for long-sequence training on single cards.

Related event: TRL v1.15 Ships with Fused LM Head by Default, Extending Single-GPU Long-Sequence Training(6 posts)→

Original post →

More from Infra

Infra channel →