Study Finds LLMs Infer Drug Class from Suffixes, Not Knowledge
allen_ai · x · 2026-08-19
Researchers at UT Austin and partners found that LLMs often lack drug-specific knowledge and instead rely on the morphology of drug names—such as suffixes like -pril or -olol—to infer answers. In tests with Olmo 3, 51–59% of drugs showed little sign of specific knowledge, while another 12–18% appeared affix-driven. Because Olmo 3 is fully open, the team traced this behavior back to the training data, revealing the source of this shortcut and its implications for health-related queries.
Related event: LLMs fake drug knowledge by guessing from name suffixes, study finds(2 posts)→
More from Models
- Feldar's longform AI models bypass AI detection tools — almmaasoglu · 2026-08-19
- User test: DeepSeek V4 Flash beats GPT 5.6 in coding — AnuranBuilds · 2026-08-19
- After a cyberattack on France's tax authority, fears Mistral's non-frontier models will guard critical systems — eliebakouch · 2026-08-19
- Reddit hails Qwen 3.8 27B as 'DeepSeek moment' for local models — InternationalGap3698 · 2026-08-19
- What Does 'Open Weights' Mean? Hugging Face Engineers Explain — HarperSCarroll · 2026-08-19
- Minimax H3 heavy dialogue generation: Are there quality shortcuts? — SorryINeedHelp1 · 2026-08-19