Paper: 3 counting examples get gpt-3.5-turbo to 99% on strawberry, showing thinking is computational
ctjlewis · x · 2026-09-28
Author ctjlewis explains the core idea of his paper: thinking is computational. Today's natural-language "reasoning" in LLMs is structurally the same thing as the pure-symbol computation in his paper, just at the level of ideas instead of symbols.
The headline experiment: adding just 3 worked counting examples to the prompt gets gpt-3.5-turbo to roughly 99% accuracy on the classic "how many r's in strawberry" question — but only because the model is forced to do explicit intermediate work counting the letters. The takeaway is that such failures reflect missing intermediate computation, not a hard capability ceiling.
He also notes recent work pretraining models on randomized Universal Turing Machines before RL, calling it solid work the field is starting to appreciate.
More from Models
- Tencent Hy4 flash and InternLM Sage-S2.1-Flash both released, tool-calling tests requested — MajesticPuzzler · 2026-11-16
- User Shares Coral Reef Creation Labeled 'Qwen 4 Max (xhigh)', an Unannounced Model Name — intellectronica · 2026-11-16
- Stealth Model 'silicon-2' Surfaces in Devin, Suspected to Be Anthropic's Next Model — kimmonismus · 2026-11-16
- Google hides Gemini model label in AI Mode, rolls Gemini 4 Carbon to Pro subscribers — gaganghotra_ · 2026-11-16
- Open-weight Karpo-Decision-31B tops Decision Index at 73.9, one forward pass per answer — CodeByPoonam · 2026-11-16
- AI daily: DeepSeek rate-limits chats, Qwen haggling spurs shop warnings, Doubao workspace launch — 快鲤鱼 · 2026-11-16