Google Cloud AI releases PLE benchmark; all frontier models score under 50%
sainingxie · x · 2026-10-23
Google Cloud AI Research released Physical-Engineering's Last Exam (PLE), continuing the series after HLE (knowledge) and ALE (digital work) — this time testing the work that builds the physical world.
The benchmark features 85 expert-reviewed tasks spanning calculations, drawings, and design reviews. Results: every frontier model scored under 50%, highlighting a major gap in real-world engineering capability.
More from Research
- DeepMind's IPO Paper Gets a 1000x Citation 'Hack' — Thanks to Another Paper Named IPO — _lewtun · 2026-10-23
- Why LLMs dissolve the long-standing barriers to formally verified software — teortaxesTex · 2026-10-23
- Japan's Moonshot IoB Brain Project Publishes 5-Year Research Posters Online — kaixhin · 2026-10-23
- Agent evals should test metric definition drift, argues dev in new post — jylusdev · 2026-10-23
- ruff author asks: how hard is scaling AI chip design from RISC-V to x86? — charliermarsh · 2026-10-23
- Transformer jointly models electrons and magnetism with 0.01% energy error — bravo_abad · 2026-10-23