FutureHouse publishes 'Millennium Problems for Biology' as wetlab-verifiable evals for AI
burny_tech · x · 2026-09-21
Reacting to reports that an internal OpenAI model solved the Navier-Stokes problem, researchers from Edison Scientific and FutureHouse (Michaela Thinks and Stephen Rodriques) argue biology lacks fast validation: even a superhuman model's proposed cures can't be verified quickly enough to serve as a frontline eval.
They propose a list of Millennium Problems for Biology:
- Each problem is extremely hard to solve but easy to validate in a simple wet lab
- The authors call it the "last reasonable eval" for AI in biology — solving any one would signal machine intelligence capable of fundamentally reshaping humanity's ability to make, measure, and model biology, with most contributing materially toward curing disease
- Full descriptions with acceptance criteria are on a dedicated website, and the authors invite the community to red-team the challenges.
Related event: FutureHouse Unveils 'Bio Millennium Problems' as Ultimate AI Benchmark(4 posts)→
More from AGI Musings
- AI debate: commenter sides with Terence Tao on the possibility of AI getting banned — teortaxesTex · 2026-09-21
- AI Is Compressing the Whole Company, Not Just Cutting Startup Costs — alexmacgregor__ · 2026-09-21
- Weighting others by relatedness isn't new: paper models agents learning relational value — xuanalogue · 2026-09-21
- Four motivations of mathematicians explain their split reactions to AI — littmath · 2026-09-21
- Binary Bits: post-AGI per-capita incomes likely cap below 10x US median if humans stay in charge — binarybits · 2026-09-21
- Debate: could post-human AI economies push GDP per capita far past 10x? — binarybits · 2026-09-21