AutoCAD-Bench says GPT-5.6 Sol leads computer-use CAD tasks with 46%
gabrielchua · x · 2026-07-24
AutoCAD-Bench shows GPT-5.6 Sol leading computer-use on precise CAD tasks
DevvMandal released AutoCAD-Bench, a benchmark for testing whether AI models can complete precise AutoCAD tasks using computer-use only.
- GPT-5.6 Sol is reported to dominate with 46%, and can one-shot many basic and intermediate tasks.
- The post also highlights a demo where the model completes an entire drawing in AutoCAD without APIs or MCPs.
- The result is framed as a strong signal for current computer-use capability in structured engineering workflows.
Related event: AutoCAD-Bench Released: GPT-5.6 Sol Leads in CAD Tasks(4 posts)→
More from Models
- BullshitBench update: GPT-6-Astra beats all prior OpenAI models but still trails Anthropic — scaling01 · 2026-09-11
- Astra Scores 83% on GauntletBench, First Computer-Use Agent to Beat Human Baseline — ducha_aiki · 2026-09-11
- Kimi K2.8 Preview rolls out: near-K3 coding performance, 1M context for all tiers — teortaxesTex · 2026-09-11
- Looking for a classifier of software engineering task shapes to pick models per task — StewartalsopIII · 2026-09-11
- DeepSeek V4 Pro API to continue after Sept 2026, billing unchanged — teortaxesTex · 2026-09-11
- DeepSeek V4.1 Flash Hits 98% of GPT-6 Astra's Score at 1.4% of the Cost in Third-Party Benchmark — ayushtweetshere · 2026-09-11