New Algorithm Frees Superword Tokens from Context Cache at COLM 2026
A COLM 2026 poster presents a new algorithm for superword tokens that eliminates the need to maintain context caches, addressing criticism that the approach slows inference while still saving tokens.
2026-10-06 ~ 2026-10-07 · 2 related posts