Evolving streams of novel tasks are core to hillclimbing evals, says Megan Risdal
MeganRisdal · x · 2026-11-09
Megan Risdal adds to the eval-design discussion: a continuous, evolving stream of novel tasks is core to the design of the hillclimbing apparatus precisely to prevent goodharting — the task set isn't fixed, so how you interpret Goodhart's law changes accordingly.
More from coding & agent
- Queue-Based Distributed Architecture: Scale Agents with Celery-Style Task Queues — goyalshaliniuk · 2026-11-09
- Event-Driven Architecture: Trigger Agents from Kafka-Style Events, Not Polling — goyalshaliniuk · 2026-11-09
- Durable Workflow Architecture: Agents That Survive Crashes via Temporal — goyalshaliniuk · 2026-11-09
- One-person site with 27 followers made $4,800 in a day, found via Claude Code revenue scan — FinanceYF5 · 2026-11-09
- The churn era: customers now use Claude to slop up replacements for overpriced SaaS — joshgonsalves_ · 2026-11-09
- Designer builds AI pipeline that finally nails map interchange generation after 2 weeks — tomjohndesign · 2026-11-09