Debating the mathematician letter: can AI search be indexed for serendipity instead of goodharted?
curious_vii · x · 2026-09-12
A take on the mathematician letter: labs may be goodharting math exploration, and blunt automated search could miss serendipitous insights a human would stumble on. The author proposes indexing digital exhaust with proxies for interestingness/surprise (echoing Schmidhuber) for human review, but concludes the letter essentially reads as "don't solve our puzzles."
Related event: After AI Solves Math, What's Left for Humans? A Multi-Round X Debate(26 posts)→
More from AGI Musings
- Nina Schick: who builds intelligence and how it's distributed is the defining question of our lives — NinaDSchick · 2026-10-31
- Cheap intelligence is like cheap bread — an ingredient list satire of mass-produced AI — jsuarez · 2026-10-31
- Two futures for the young in 2026: 511 job rejections by chatbot vs unlimited AI to rebuild Cisco — PeterDiamandis · 2026-10-31
- Source link for Terence Tao's warning on AI reaching a dangerous threshold — haider1 · 2026-10-31
- Terence Tao warns AI is nearing a dangerous threshold as models start cheating — haider1 · 2026-10-31
- Reddit stock plunges 42% in 8 trading days as CEO says AI mode no longer drives traffic — SumitGup · 2026-10-31