New superword tokens algorithm drops the context overhead, saving tokens at COLM 2026

yuvalpi · x · 2026-10-07

Responding to skepticism that superword tokens are impractical and slow, the authors show their new algorithm eliminates the need to keep contexts. Work with Craig Schmidt and Chris Tanner (Kensho, Ben-Gurion University), presented as poster #139 at COLM 2026.

Related event: New Algorithm Frees Superword Tokens from Context Cache at COLM 2026(2 posts)→

Original post →

More from Research

Research channel →