Will DePue: Reverse RL and Large-Scale Sampling Could Recover Model Distribution
willdepue · x · 2026-07-27
Will DePue adds technical insights to the model forensics discussion, noting that distillation forensics are understudied. He suggests that if you can reverse RL and sample from the base model at scale, you could probably recover the original distribution.
Related event: Experts Discuss Forensics for Open-Source Models(3 posts)→
More from Research
- Yale PhD student open-sources his paper figure scripts, packaged as a Skill for Claude Code and Cursor — burny_tech · 2026-09-23
- AI models now match superforecasters on ForecastBench; rematch set for October — burny_tech · 2026-09-23
- Dev uses Opus 5.5 with Lean to formally verify Claude Agent SDK, yielding 16 bug-fix PRs — bcherny · 2026-09-23
- Mathematicians, not just LLMs, made AI's math breakthroughs possible, scholars argue — tak3sh8 · 2026-09-23
- AI-enabled drug discovery cuts discovery time by 15-80%, McKinsey research finds — menhguin · 2026-09-23
- Gemini training details dissected: groupwise reward redistribution to fight reward hacking — nrehiew_ · 2026-09-23