N=1100 experiment: Google AI Mode cuts CTR 18% while hurting user experience
VeryWellVersed · x · 2026-11-17
A controlled study circulating on X (the arXiv paper "AI in Search Reduces Publisher Referrals Without Improving User Experience" by a Penn/Northeastern team, N=1100 preregistered field experiment) compared Current Search, AI Mode, and no AI:
- AI Mode cut click-through rates by 18%
- Reduced perceived usefulness, satisfaction and control
- Searches took 0.43 minutes longer
- Users searched less often, at 0.92 fewer sessions per day
Findings suggest generative AI in search reshapes online attention away from publishers without improving user experience or trust.
More from Research
- BrickFlow uses SE(3) flow models to reconstruct buildable LEGO assemblies from images — Peter Kulits · 2026-11-17
- Meta-model writes weight updates from one paragraph, beating LoRA on many benchmarks — gdm3000 · 2026-11-17
- SPARE preprint: 2.55x faster decoding for linear attention on a 1.3B model — krishnan · 2026-11-17
- Study estimates ~12% of philosophy published today may be AI-generated — leland_mcinnes · 2026-11-17
- Berkeley EECS & Statistics open all-rank faculty search in AI for Physical Sciences — berkeley_ai · 2026-11-17
- Origami as physical reservoir computing: powering robotic crawling in Scientific Reports — cephaloform · 2026-11-17