Greg Kamradt: benchmarks should measure AI's contribution to the frontier of knowledge
GregKamradt · x · 2026-11-04
Greg Kamradt says he's increasingly interested in benchmarks that measure AI's contribution to a frontier of knowledge rather than task completion — a pointed critique of current eval culture's focus on fixed task-solving over expanding human knowledge.
More from AGI Musings
- Who gets to be expensive? Agents get subsidized while companion users get rationed — serialchilla91 · 2026-11-05
- Watching lots of AI video makes 'real vs AI' a perceptual property you can flip — dioscuri · 2026-11-05
- Nature paper unveils AutoDNA, an AI-native lab where humans only maintain the hardware — EricTopol · 2026-11-05
- ChatGPT found a dead squirrel, not a $1,300 repair: AI saved one homeowner $3,000 in 3 weeks — neil_chilson · 2026-11-05
- CVPR's 25-papers-per-author cap sparks backlash: 'AI slop' submitters just throw darts — mofoss · 2026-11-05
- Does more model intelligence still matter for coding past a threshold? — the_juan_1 · 2026-11-05