Researchers Blasted for Weak AI Fundamentals; LLMs Aren't Just Word Statistics

Gerald Sans criticized AI researchers for skipping fundamentals like the difference between training and inference, while developers pushed back on claims that LLMs are merely word-frequency machines, arguing this conflates the training task with the trained model.

2026-10-03 ~ 2026-10-04 · 4 related posts