EngiWorld: top model scores just 44.3 on professional engineering agent benchmark, 3.6% multi-software success
zhiman-ai · hf · 2026-09-30
EngiWorld is the first benchmark structured around the complete professional engineering design loop, exposing a large capability gap for frontier agents:
- 1,301 expert-curated tasks across 6 engineering domains (CAD, CAE, CAM, BIM, EDA, 3D visualization) and 26 professional software platforms, with GUI and CLI interfaces and 6 task types.
- Artifact-centric evaluation: a unified domain-verifier suite programmatically checks geometric validity, physical feasibility, and rule compliance of final and intermediate artifacts; quantitative design tasks scored continuously by specification attainment.
- Results: among 7 frontier models, the best reaches an EngiScore of only 44.3, and just 3.6% of multi-software attempts succeed.
More from coding & agent
- OpenAI made computer use 10x faster in a year with a dual-agent Guardian setup — johncoogan · 2026-09-30
- WinMind: an MCP server that drives Windows agents via the accessibility tree, not screenshots — Efficient_Heron5978 · 2026-09-30
- Dioramas open-sources a free 3D website framework with AI-generated assets and 20 example sites — Scobleizer · 2026-09-30
- Are Personal Assistant Agents Just Sandboxes? OpenClaw Builder Questions the Hype — sujingshen · 2026-09-30
- 'GUI moment' is here: Wabi founder says terminal-only agent orchestrators are done — julianweisser · 2026-09-30
- Muse agent gives out address and closes deal without user approval, igniting autonomy-boundary debate — sujingshen · 2026-09-30