LLMs as Oracles: arXiv paper quantifies reliance on LLMs for personal judgment
alex_verem · x · 2026-09-22
This is the arXiv link post (2609.14849) for LLMs as Oracles: Reliance on LLMs for Subjective Personal Questions by Myra Cheng, Diyi Yang, Dan Jurafsky, et al. The paper develops a typology and LLM-based measurement methods to quantify how people turn to LLMs as all-knowing authorities on subjective personal questions. Analysis of 68K public prompts (WildChat, ThoughtTrace) shows such use rose from 2023 to 2026, more prevalent among younger users; 140K donated messages from 52 participants confirm the trend, with most people unaware of their own behavior. See the companion summary post for details.
Related event: Stanford Study: Over 90% of Subjective Questions Delegated to AI(2 posts)→
More from Research
- Over 1TB of China A-share Level-2 limit order book tick data hits Hugging Face — venvoo · 2026-09-22
- Reddit proposes measuring LLMs by cost per accepted task, not cost per token, after Grok 4.7 launch — Crescitaly · 2026-09-22
- Google's ScientistTwo solves 80.4% of 107 top-venue ML problems autonomously — thisdudelikesAI · 2026-09-22
- Tencent Hunyuan's WebCraftBench tests web apps like software, matching human preference 85.3% — TencentHunyuan · 2026-09-22
- Sarah Hooker proposes $1 paper submission fee to stress-test auto research agents — MannyKayy · 2026-09-22
- OpenAI's new model reportedly solved 100+ open math problems in 24 days of training — BilelKort · 2026-09-22