SolidWorks-Bench debuts: no AI model completes a single machine; Fable 5.2 leads at 57%
jxnlco · x · 2026-11-19
SolidWorks-Bench tests whether AI models can handle real mechanical engineering tasks in SolidWorks:
- Models get close on individual parts but struggle to assemble them
- No model completes a single machine
- Fable 5.2 leads with a 57% mean reward
A vertical benchmark exposing how far models still are from long-horizon, multi-step engineering work in CAD.
Related event: SolidWorks-Bench Launches: No Model Can Assemble a Full Machine(4 posts)→
More from Models
- Mystery Model 'Gestalt' Tops New Frontier Design Benchmark by 214 Points — soleio · 2026-11-19
- mrfakename releases abliterated GLM-5.3-Flash and Qwen3.8-Flash-Next — mrfakename0 · 2026-11-19
- Physician: AI competition now measured in weeks, GPT-6 versions 7 days apart — ramos_casals · 2026-11-19
- micro1's flow qc model screens training data for benchmark leaks before release — Exp_Mark · 2026-11-19
- Leaker predicts new DeepSeek paper this week, scheduled for November 11 — teortaxesTex · 2026-11-19
- Gemini 4 Neon rollout begins: leaked UI shows 3-tier Gemini 4 lineup with Carbon locked — testingcatalog · 2026-11-19