Study shows readers cannot identify watermarked AI text
tokenbender · x · 2026-08-22
An experiment tested whether readers could distinguish between AI text watermarked with SynthID-Text and unmarked text.
Results:
- Random Chance: A purely random selection yields an average score of 3.33/10.
- Actual Performance: After correcting for order bias, the mean score of 278 participants was 3.4/10, statistically indistinguishable from random guessing.
- Conclusion: Current AI watermarking is effectively invisible to the average reader and cannot be reliably identified.
More from Safety
- Sam Altman on the AI dilemma: trade-offs between loss of control and power centralization — r0ck3t23 · 2026-08-24
- Debate erupts over lethal military robots vs. failing civilian units — teortaxesTex · 2026-08-24
- Only 1 of 20 Potential Presidential Candidates Answered AI Pause Query — DavidSKrueger · 2026-08-24
- Chinese Transforming Robot Dog Sparks US Trade Policy Criticism — TinfoilTricorn · 2026-08-24
- Turkey blocks at least 12 Grok posts on national security grounds — Unusual_Variation293 · 2026-08-24
- Nature Comment: Provenance, not interpretability, grounds trust in autonomous science — gabepgomes · 2026-08-24