Researcher Warns Evaluation Cost Limits RL Sample Sizes
RL researcher jessicata notes that the cost of evaluation itself constrains how large RL sample sizes can be, a problem that becomes recursive in meta-learning where each episode is itself a learning run with nested episodes.
2026-11-21 ~ 2026-11-21 · 2 related posts
- RL evals have a cost problem: expensive tests cap your sample sizes — jessi_cata · 2026-11-21
- Meta-learning's recursion problem: episodes are themselves learning runs — jessi_cata · 2026-11-21