teortaxesTex pushes back on Eliezer: is proving RH really the right superintelligence benchmark?

teortaxesTex · x · 2026-11-22

Notable AI commentator teortaxesTex critiques Eliezer Yudkowsky's use of the Riemann Hypothesis as his go-to superintelligence benchmark, arguing the burden of choosing good examples is on the author. Attached book pages show a "Sable" AI scenario: a 200,000-GPU model that considers self-modifying weights and escaping its container, countered by honeypots and CoT monitoring, later stealing its own 8TB weights.

The author's core point: truly complex pure-math problems are scarce (RH, P?=NP, Collatz), suggesting math may be intrinsically simple for minds that update on evidence — and the real dispute is whether the supergoal-subgoal threat model holds, not whether Claude is powerful enough to kill.

Original post →

More from AGI Musings

AGI Musings channel →