Frontier AI now beats junior accountants on speed and accuracy, Mercor study finds
emollick · x · 2026-10-02
Mercor hired 12 junior CPAs (avg 5.5 years experience) to complete simplified tasks from its APEX-Accounting benchmark.
- On medium-length, well-defined accounting tasks, frontier models are now faster and more accurate than junior accountants — even the best one in the study
- 18 months ago the best models scored below the human average of 37%; today models nearly ace the same tasks
- Caveat: tasks measured what AI is best at (detail-oriented instruction following), not the full job — unstructured work like client communication still favors humans
Ethan Mollick notes productivity gains are coming even if model progress froze today. Mercor considered not publishing the provocative results.
More from AGI Musings
- Dev challenges "AI will solve humanity's problems": where exactly in the next 5 years? — aronchick · 2026-11-17
- Top researchers are quietly stopping paper submissions, observer notes — avt_im · 2026-11-17
- "Abundant intelligence should terrify businesses built on keeping it scarce" — _AustinCalvert_ · 2026-11-17
- 130-page paper introduces "bottleneck pressure": work AI can't do gains value as the rest speeds up — soumitrashukla9 · 2026-11-17
- AI conference authors and reviewers complain unprecedentedly about AI slop — khademinori · 2026-11-17
- Sam Altman: AI already speeds up OpenAI's research, but a self-improving button? 'Definitely not' — ChrisGPT · 2026-11-17