Modus releases Financial Audit Bench testing AI on real junior-auditor work
garrytan · x · 2026-10-02
Modus Audit Labs has released Financial Audit Bench, an open-source benchmark testing whether AI can do actual junior-auditor work rather than just answer accounting questions. Garry Tan predicts every job will eventually get eval benchmarks like this.
More from Research
- SYNTH paper finds epistemic calibration emerges in models from 300M parameters — cephaloform · 2026-10-02
- Failure Map: 20,168 open Python boundary-case bug repair tasks released — failuremap-f · 2026-10-02
- Nemotron 3 Ultra report reveals MOPD distillation teachers must share compatible training pipelines — cwolferesearch · 2026-10-02
- Sasha Rush publishes tutorial on sampling without randomness, centered on variance reduction — srush_nlp · 2026-10-02
- Self-attesting ledgers proposed as fix for missing shared baselines across AI labs — pratyusha_PS · 2026-10-02
- Researchers show AI models can "reproduce": mating by complementary strengths, no gradient descent — rvp · 2026-10-02