SolidWorks-Bench: no AI model can assemble a single machine; Fable 5.2 leads at 57.3%
DevvMandal · x · 2026-11-19
SolidWorks-Bench tests whether AI models can handle real mechanical engineering tasks in SolidWorks. Models get close on individual parts but fail at assembly—no model completes a single machine. Fable 5.2 leads at 57.3% mean reward, ahead of GPT-6 Astra (42.6%), Sonnet 5.5 (34.7%), Opus 5.5 (34.2%), Kimi K3.1 (19.6%), DeepSeek V4.1 (12.7%), GLM 5.3 (7.3%), and MiniMax M3.1 (2.4%).
Related event: SolidWorks-Bench: No AI Can Assemble a Full Machine(2 posts)→
More from Models
- Heavy testing finds Astra 6.2 High slightly worse than 6.0 and 2x slower — IridiumEagle · 2026-11-19
- Heavy Astra 6.2 testing still can't exhaust the $100 plan's usage quota — prd_008 · 2026-11-19
- Gemini 4 Carbon Deciphers an Unread 1466 Sforza Renaissance Cipher Unaided — fofrAI · 2026-11-19
- Gemini's mysterious "Hydrogen" selector appears to route to Gemini 3.1 Pro — Neestor00 · 2026-11-19
- Fable 5.2 vs GPT-6.2 Astra: 108M vs 24M tokens to build the same PS1-style game — heypearlai · 2026-11-19
- Same game prompt: Astra ships for $17 vs Fable's $65 — 3x cheaper, fewer bugs — heypearlai · 2026-11-19