VybBench open-sourced: top image models change 90%+ of pixels on tiny edits
balajiln · x · 2026-11-06
Coco Labs open-sourced VybBench (Apache 2.0), a benchmark testing exact fonts, exact colors, and minimal edits across 145 fonts, 100 colors and 200 edit tasks. Top image models changed 90%+ of pixels on average: ChatGPT Image 95.5%, Muse 91.9%, Recraft 98.9%. Repo surpassed 1,000+ HF downloads in week one; clone and run with pip install -e and vybbench score.
More from Multimodal
- World Labs world model demo shows actual moving people in generated scenes — andrew_n_carr · 2026-11-06
- Grimes stars in first AI film to hit theatres, gunning for Best Animated Feature Oscar — TomLikesRobots · 2026-11-06
- AI-generated video now looks like full TV show episodes — Additional_Judge_337 · 2026-11-06
- AI-generated Willem Dafoe Green Goblin shots show how far image models have come — egeberkina · 2026-11-06
- How Grimes' cameo in theater-bound AI film 'Gods Don't Give Gifts' came together — DavidmComfort · 2026-11-06
- Is LTX 2.5 broken in ComfyUI? Users report eerie, degraded outputs — brocolongo · 2026-11-06