Allen AI's byte-level language model paper accepted to Nature

allen_ai · x · 2026-10-08

Allen AI announced that its paper on retrofitting language models to operate over bytes — the approach behind Bolmo — has been accepted to Nature.

The team is also releasing new checkpoints that extend the method from Olmo to Qwen and Llama. Author Tom Limi said he never expected to publish in Nature, let alone on byte-level language models.

Related event: AI2's byteification method accepted by Nature, Bolmo extended to Qwen and Llama(11 posts)→

Original post →

More from Models

Models channel →