Sampled audit finds 89.7% of African news site's 2026 articles AI-generated; detector FP rate ~1 in thousands

thinksmall3r · x · 2026-11-17

Crémieux Recueil's audit of the Pan-African Review using Pangram 4.0 shows 0% flagged across 2019-2023 (30 articles/year), 3.3% in 2024, 50% in 2025, and 89.7% of 39 articles in 2026 judged AI-generated or AI-assisted — likely LLM content farms. ctjlewis adds he personally measured a 1-in-thousands false positive rate on tweets, the shortest and most FP-prone text, suggesting the detector is more reliable than it officially claims.

Original post →