FrontierPhysics benchmark enlists 42 physicists to grade research agents end-to-end
HanchungLee · x · 2026-11-06
BenchFlow launched FrontierPhysics, a benchmark evaluating AI agents on end-to-end physics research. Its core team from Berkeley, Caltech and Harvard physics labs recruited 42 physicists from 26 institutions (28 with Nature/Nature Physics/PRX/PRA papers), with scoring designed to capture the nuanced judgment physicists care about. Artificial Analysis will host the evaluation.
More from Models
- NaceAI open-sources Drex decision models, hitting SOTA 67.52 on Decision Index — nischay_twt · 2026-11-06
- Users say Claude Opus 4.8 is 'so stubborn even its own classifiers can't stop it' — repligate · 2026-11-06
- Miles Brundage: Inkling 2 Small is good — Miles_Brundage · 2026-11-06
- Users claim Claude performs better with an empty system prompt than Anthropic's official one — repligate · 2026-11-06
- Palisade's Jeff Ladish: models better at everything but still not funny or persuasive — JeffLadish · 2026-11-06
- Palisade's Jeff Ladish calls to revive METR time-horizon estimates for new models — JeffLadish · 2026-11-06