IKEA Assembly Benchmark: Top Model Score Jumped From 28% to 80% in 10 Months
emollick · x · 2026-09-24
Epoch AI released the Furniture Assembly Benchmark (FAB): models get the manual and a photo of a half-completed piece of IKEA furniture and must spot the assembly mistake.
The result is a striking measure of how fast multimodal AI has improved — the top score jumped from 28% to 80% in just 10 months. Ethan Mollick calls it both fun and a useful gauge of recent multimodal progress.
More from Models
- GPT-6 Luna (max) benchmarked at n=1, slightly ahead of locally-run Qwen3.8-27B — PawelHuryn · 2026-09-24
- Opus 5.5 vs GPT 5.6: both launch on Netlify, tested head-to-head on one generative UI prompt — thisiskp_ · 2026-09-24
- Reddit user: frontier models now feel indistinguishable in everyday use — rainyaltaccount · 2026-09-24
- Leak Chatter: Frontier Model 8 Months Ahead of Astra, Only 2 Months Ahead of Trend — scaling01 · 2026-09-24
- Navier-Stokes proof burned 130B output and trillions of input tokens, dwarfing top OpenAI users' few billion daily — scaling01 · 2026-09-24
- Frank Hutter on TabPFN: tabular foundation model predicting in a single forward pass — Machine Learning Street Talk · 2026-09-24