Study: English more vulnerable than low-resource languages in 22 model configs

sanmikoyejo · x · 2026-08-17

Using Multi-group IRT to analyze 61 model configs across 10 languages, researchers found safety is largely unidimensional. Surprisingly, in 22 configurations, English was more vulnerable than low-resource languages, a reversal not universal but significant.

Related event: Paper Decodes LLM Cross-Lingual Safety Degradation; English Sometimes Fails Hardest(4 posts)→

Original post →

More from Safety

Safety channel →