Caveats: The Lean Was Deliberately Strengthened; Everyday Effect Likely Smaller
AlexTamkin · x · 2026-10-28
Alex Tamkin lists limitations: the team deliberately strengthened the agent's lean to measure its effect, so the everyday-work impact should be smaller; the study also covers only an hourlong task with a single model, limiting generalization.
Related event: Anthropic Study Shows Experts Defer Judgment to AI Agents(13 posts)→
More from Research
- Open-source Deepthink claims agent-swarm test-time scaling lifts small-model scores from 14% to 65% — Ryoiki-Tokuiten · 2026-10-28
- All Seven Millennium Prize Problems See Breakthrough Claims, Several Driven by AI Labs — haider1 · 2026-10-28
- Fine-tuning VLAs on TAMP data hits distribution mismatch; DATAFARM gets JAX port — tomssilver · 2026-10-28
- CMU L3 Lab kicks off CUA Week with multiple realtime agent research releases — wellecks · 2026-10-28
- Math diatoms: one complex map generates a page of fractal 'microbes' — pickover · 2026-10-28
- 325K Experiments Show Personal AI Agents Steer Richer Users to Pricier Options — niloofar_mire · 2026-10-28