GPT-5.5 hits 99.46% on multi-digit multiplication with pure reasoning, no tools
maksym_andr · x · 2026-09-17
Quoting cozyblazex's redo of the multi-digit multiplication experiment: GPT-5.5 aced the test with 99.46% accuracy using medium reasoning and 7 samples per cell, relying purely on reasoning with no tool calls.
maksymandr adds the caveat that in practice any reasonable LLM would call external tools for multiplications beyond 5x5 digits, yielding uniform 100% accuracy at low reasoning — these evals measure intrinsic capability, not real-world usage.
Related event: Frontier LLMs Nail 20-Digit Multiplication Without Tools(9 posts)→
More from Models
- 'You Can Feel the Gradient Slopes': Dev Contrasts Benchmaxxed RL Models vs General Ones — theteknosaur · 2026-11-02
- LightOnOCR-3 Launches: Tops FRBench, Adds Layout Structure and Chart Extraction — IgorCarron · 2026-11-02
- NVIDIA's Kumo Is a Family of Four Tabular Foundation Models, Not Just One — pandeyparul · 2026-11-02
- SemiAnalysis: safety classifiers are underrated — Meta's Muse tops cyber benchmark at 35.2% — ThomasScialom · 2026-11-02
- DeepSeek V4.1 Flash 1017 wins over a longtime closed-source-only user: fast, cheap, reliable — _bachrc · 2026-11-02
- Local quants vs Claude on 9 real private bugs: 3-bit costs thinking time, not score — FeydRowan · 2026-11-02