Token-space font compiler renders text with equal-width tokens to explain LLM quirks
amplifiedamp · x · 2026-09-26
- Tool: A "Token-space font compiler" turns any font + tokenizer into a font where every token is equal width, visualizing how models actually segment text.
- Motivation: Built with Astra as an early prototype to build empathy for why models have quirks like miscounting letters in "strawberry".
- How to use: Compiles locally in the browser, exports TTF, and ships a Vesktop/Vencord theme so specific Discord users' messages render token-monospaced, with full setup instructions.
Related event: Developer ships token-space font compiler to visualize how AI sees text(5 posts)→
More from Fun
- "Stop reading your AI's replies": a satirical takedown of vibe coding culture — netherreddit · 2026-09-26
- Feeding YuE 2 an empty lyric field yields a song full of gibberish vocals — SteveLittleFish · 2026-09-26
- New Game 'OUT OF THE SANDBOX' Makes You Interrogate an AI Before It Escapes — BLUECOW009 · 2026-09-26
- Two prompts, $30 in tokens: opus 5.5 builds a playable zoo tycoon game — jacob_posel · 2026-09-26
- Boardy AI Is So Human-Like a User Suspects a Real Person Is Hiding Inside — GlenBradley · 2026-09-26
- 'How using Opus 5.5 feels rn' — the meme says it all — zainhas · 2026-09-26