Fully open release: SGLang integration, H200/B300 kernels and all training details published

francoisfleuret · x · 2026-11-03

In response to a technical question on parallelizability, the team confirms everything is open-sourced: code with SGLang integration and context parallelism, custom kernels for H200 and B300 GPUs, plus full training and inference details. Paper, code, and blog links are provided, with NVIDIA and Nebius as partners.

Related event: Open-Source LSA Sparse Attention Extends Qwen 27B to 10M-Token Context(3 posts)→

Original post →

More from Infra

Infra channel →