John Schulman says distillation forensics can also be measured with logprobs
johnschulman2 · x · 2026-07-27
The reply adds a technical note to a discussion about distillation forensics: one way to investigate it is by measuring logprobs.
It is a very short comment, but it still conveys a concrete methodological idea rather than a pure social exchange.
Related event: Experts Discuss Forensics for Open-Source Models(3 posts)→
More from Research
- Yale PhD student open-sources his paper figure scripts, packaged as a Skill for Claude Code and Cursor — burny_tech · 2026-09-23
- AI models now match superforecasters on ForecastBench; rematch set for October — burny_tech · 2026-09-23
- Dev uses Opus 5.5 with Lean to formally verify Claude Agent SDK, yielding 16 bug-fix PRs — bcherny · 2026-09-23
- Mathematicians, not just LLMs, made AI's math breakthroughs possible, scholars argue — tak3sh8 · 2026-09-23
- AI-enabled drug discovery cuts discovery time by 15-80%, McKinsey research finds — menhguin · 2026-09-23
- Gemini training details dissected: groupwise reward redistribution to fight reward hacking — nrehiew_ · 2026-09-23