NetHack Porting Challenge: AI Hits 99.5% Accuracy but Readability Suffers
David Bau's Teleport Coding Challenge tasked AI with porting NetHack from C to JavaScript: top results hit 99.5% accuracy but with poor readability and no perfect score. Bau argues current benchmarks reward cheap 85% solutions, though in coding even 15% errors are unacceptable.
2026-10-31 ~ 2026-10-31 · 3 related posts
- NetHack port challenge: AI transpilers hit 99.5% correctness but tank readability — davidbau · 2026-10-31
- Vals Code Migration Leaderboard: Claude Sonnet 5.5 Tops at 86.88%, DeepSeek Costs $1.76 — davidbau · 2026-10-31
- Nobody Has Fully Ported NetHack: David Bau on the Correctness vs. Readability Tradeoff in AI Code — davidbau · 2026-10-31