AI Detectors Fail When Imitating Writing Styles
FlorianGallwitz · x · 2026-07-18
An Epoch AI study tested several AI detectors across different text types:
- For human writing, detectors rarely misidentified it as AI text.
- For directly generated LLM text, the false negative rate was extremely low, around 0%0.7%.
- However, when an LLM was prompted to mimic a real author's style, detectors failed noticeably: the false negative rate across different tools jumped to roughly 10%18%.
- In scientific writing scenarios, the false negative rate was even higher, reaching about 26%.
The chart also details sample sizes and error margins. The conclusion is that while AI detectors are good at catching "blatant AI text," their reliability drops significantly when faced with content designed to mimic specific authors.
More from Research
- New review: how prefrontal cortex dynamics turn world models into flexible behavior — AnnaCiaunica · 2026-10-27
- LIBERO-MAX: Robot Policies Drop 11–26 Points When the World Changes Mid-Task — drmapavone · 2026-10-27
- Kolab Benchmark Uses Pro Screen Recordings to Show AI Agents Overestimate Collaboration Quality — minnesotanlp · 2026-10-27
- One BBQ Example Pushes LLM Fairness Scores Past 90%, EMNLP Paper Questions Benchmarks — radamihalcea · 2026-10-27
- Real2Sem2Real turns one phone video into 2,000+ robot demos, matching 150 teleop demos — Scobleizer · 2026-10-27
- Understanding MuonH (Hyperball) through weight norm geometry of scale-invariant networks — jasondeanlee · 2026-10-27