BooBench: A Halloween Benchmark That Scares LLMs and OCR Tools Into Character-Repeating Meltdowns
xennygrimmato_ · x · 2026-11-01
Jerry Liu's team released Boobench, a fun Halloween benchmark designed to "scare" LLMs and OCR tools into repeating characters endlessly — mirroring a real-world failure mode where repeated characters in documents send models completely off the rails. The dataset and eval are open-sourced on GitHub and Hugging Face.
More from Fun
- Grok-o-lantern: drop any SVG into this three.js scene to carve a pumpkin — majidmanzarpour · 2026-11-01
- Core Memory Trailer: Friends Torn Apart by the Robot Race — kyliebytes · 2026-11-01
- Claude writes, directs and acts an AI puppet show; Episode 4 adapts The Monkey's Paw — Slackluster · 2026-11-01
- Podcast: From Playwright to Apple Designer to Building Social AI Startup Hivemind — soleio · 2026-11-01
- Dev builds a talking Grok-o-lantern in three.js, lets anyone carve one from an SVG — majidmanzarpour · 2026-11-01
- Teknium confirms Hermes mobile app beta launched on both iOS and Android — Teknium · 2026-11-01