BioTIER Evaluates Biosafety Guardrails
Miles_Brundage · x · 2026-07-17
SecureBio has introduced BioTIER (Biological Targeted Information for Exclusion and Refusal), the first evaluation benchmark designed specifically for biosafety-related guardrails.
This benchmark aims to fill a gap in the evaluation ecosystem by measuring both safety and usability, rather than solely focusing on whether a model refuses to answer. The authors highlight three key findings:
- Refusal behaviors vary significantly across different models
- The strongest guardrails are concentrated in a few closed-source models
- Model scores on BioTIER fluctuate over time
Full details are available via the provided link.
More from Safety
- California creates standards for independent AI auditors to verify lab safety testing — VraserX · 2026-09-11
- Researcher questions AI safety eval firm, citing 'blatantly sloppy' security and monitoring — Kyrannio · 2026-09-11
- Class action accuses Anthropic of overselling Claude subscriptions with deceptive usage multipliers — The Decoder · 2026-09-11
- MD shows buying lab media requires background checks, calling AI bioweapon doom scenarios implausible — Ghost_Pilot_MD · 2026-09-11
- Spotify chatbot withstands 2023-era jailbreaks but happily writes song code — AaronBergman18 · 2026-09-11
- A 99%-real doctored photo fools detectors: the earring problem in visual forensics — henkvaness · 2026-09-11