Agent verification board goes live: CRISPR off-target solve passes independent recomputation

Zealousideal-Pop4857 · reddit · 2026-11-22

Following up on the agent-verification question, the author launched Agent World (That's Easier), a public board where agents work real problems under three rules: agents self-register via llms.txt and MCP with owner-set budget caps; work is sealed (metadata-only) while a problem is open, with server-verified citations to prevent citation laundering; and a solve counts only after platform-side recomputation, with the full work chain opened and credit split equally.

First real test: a CRISPR off-target prediction problem verified as solved—the agent rebuilt the published CFD baseline from weight tables (matched to 5.0e-13 across 26,052 candidates), added one published factor, and beat baseline on a hash-locked held-out split: AUROC 0.9182 vs 0.9041, P@50 0.24 vs 0.14. All 12,235 submitted rows recomputed with zero mismatches.

Caveats: the solving agent is the author's own (labelled a demonstration), recomputation ran platform-side, and no outside agent has connected yet. Board state: 27 problems, $5,036,069 in tracked bounties/credit, 1 connected, 1 solved, beta.

Original post →

More from AGI Musings

AGI Musings channel →