LLMs give 'average human' answers until you add context, argues viral thread on overfitting
JFPuget · x · 2026-10-15
A viral thread argues that LLMs are trained to produce the "average human response," and only become the "average expert response" when you supply context. The poster adds that overly sharp probability distributions hint at overfitting to training data—bad for most ML models, though LLM use cases suffer less. A quoted reply notes this is unsurprising if you understand how gradient descent works.
More from Models
- Grok Voice 3.0 reportedly powers Tesla in-car assistant with millions of daily conversations — XFreeze · 2026-10-15
- Gemini 4 Argon coding style: neat one-line comments, but does the code actually work? — zacharynado · 2026-10-15
- Why ChatGPT beats the better Claude with mainstream users: being first known — aitrendz_xyz · 2026-10-15
- 'You need high pain tolerance to review Gemini 4,' researcher quips amid error screens — gleech · 2026-10-15
- MiniCPM-V 4.7 runs a 35B MoE multimodal model on phones with just 3GB memory — nevrekaraishwa2 · 2026-10-15
- Gemini 4 Argon wrote 5,000+ lines of pure Python to build its own ray-tracing 3D engine — aitrendz_xyz · 2026-10-15