New Algorithm Frees Superword Tokens from Context Cache at COLM 2026

A COLM 2026 poster presents a new algorithm for superword tokens that eliminates the need to maintain context caches, addressing criticism that the approach slows inference while still saving tokens.

2026-10-06 ~ 2026-10-07 · 2 related posts