Researchers Blasted for Weak AI Fundamentals; LLMs Aren't Just Word Statistics
Gerald Sans criticized AI researchers for skipping fundamentals like the difference between training and inference, while developers pushed back on claims that LLMs are merely word-frequency machines, arguing this conflates the training task with the trained model.
2026-10-03 ~ 2026-10-04 · 4 related posts
- Saying AI works like human minds misunderstands both, argues post — OscarMDavies · 2026-10-03
- LLMs Aren't Markov Chains: Dev Pushes Back on "Next-Word Parrot" Claim — austinc3301 · 2026-10-04
- Even some AI lab researchers confuse the transformer forward pass with the autoregressive loop — gerardsans · 2026-10-04
- AI researcher blasts labs: a decade after "Attention Is All You Need", basics still unlearned — gerardsans · 2026-10-04