Human baselines for benchmarks: AI now outperforms junior accountants, Mercor says
ResultBackground2450 · reddit · 2026-10-02
Mercor published a blog post arguing for human baselines in benchmarks, showing that top AI models now outperform junior accountants on relevant evaluations. The result offers a quantified reference point for how quickly AI is replacing entry-level white-collar work, and raises questions about how benchmarks should be calibrated against human skill levels.
Related event: Mercor Benchmark: Frontier AI Now Beats Junior Accountants(5 posts)→
More from AGI Musings
- Oxford economist Carl Frey calls for legislation to establish 'learning rights' over what AI learns — carlbfrey · 2026-10-02
- Full video: Shane Legg says remote cognitive jobs most exposed to AI automation — rohanpaul_ai · 2026-10-02
- DeepMind's Shane Legg: All remote cognitive jobs are most exposed to AI automation — rohanpaul_ai · 2026-10-02
- Elijah Meeks: calling out bad AI writing is fair, whatever the tool — Elijah_Meeks · 2026-10-02
- Alexis Gallagher Mocks AI Consciousness Debate With Orwellian Jibe — alexisgallagher · 2026-10-02
- New Paper: LLM 'Polyphony' Breaks Our Usual Inferences About Understanding — burny_tech · 2026-10-02