BioBench Joins Fireworks' Intelligence Index: 1,337 Tasks Testing Bio Agents and Safeguards
kenbwork · x · 2026-10-29
Benchmarks.Bio partners with Fireworks AI to add BioBench to its Specialized Intelligence Index. The benchmark spans 1,337 agentic biology tasks (omics, therapeutics, oncology applications, refusal grading), with workflows of 50+ turns lasting up to 10 hours, evaluating both frontier capability and biosafety safeguards.
More from Safety
- Making misleading scary demos like the blackmail study harms AI safety itself — jessi_cata · 2026-10-29
- AI safety row: do Anthropic's 'misleading' blackmail demos harm the information commons? — jessi_cata · 2026-10-29
- Radio show examines regulatory rules and liability for AI-generated influencer ads — aziz4ai · 2026-10-29
- 'Mistral is not France': Hugging Face dev pushes back on France picking an AI champion — AymericRoucher · 2026-10-29
- UK to pour another £120M into AI model testing lab, 10x its US counterpart's budget — Miles_Brundage · 2026-10-29
- a16z survey: all top 7 CISO priorities for 2027 now AI-related, agent security jumps 28 pts — a16z · 2026-10-29