OpenAI LLM flags ML paper title 'Deep Ignorance' as biological risk, refuses task

burkov · x · 2026-10-21

Andriy Burkov found OpenAI's LLM refused to extract information from a paper titled "Deep Ignorance: Filtering Pretraining Data Builds Tamper-Resistant Safeguards into Open-Weight LLMs," flagging it for possible biological risk. A screenshot shows an HTTP 400 error advising rephrasing, linking to OpenAI's biology-safety blog post. The irony: a paper about tamper-resistant safeguards got blocked by overzealous safeguards — Deep Ignorance in its glory.

Original post →

More from Fun

Fun channel →