Redditor amazed LLM progress still runs on next-word prediction, not symbols
umotex12 · reddit · 2026-10-15
A Reddit user admits he expected LLMs to be a dead end, with AGI requiring something more sophisticated like symbol-based reasoning. Seeing sustained progress from next-word prediction pushed to its limits surprised him, suggesting language use itself is genuinely special. He also wonders what happens once Astra or Gemini 4 loops start designing the next models.
More from AGI Musings
- Todd: putting your forecast numbers in writing is what really counts — ben_j_todd · 2026-10-23
- Humanities dissertations have collapsed, social sciences are next — with AI as one driver — gsiemens · 2026-10-23
- Greg Brockman: AI makes hacking 100x more profitable and easier, upending hacker economics — gabriel1 · 2026-10-23
- 'Nothing is real now on social media': viral demo shows AI-generated content everywhere — saibharadwaj · 2026-10-23
- Lilian Weng to Discuss Recursive Self-Improvement at SGLang Summit 2026 — BanghuaZ · 2026-10-23
- mmitchell_ai questions whether the AI safety vs security framing stems from EA — mmitchell_ai · 2026-10-23