AI Scientist limitations: Selective reporting and code-method divergence remain
SRSchmidgall · x · 2026-08-29
Despite significant reductions in errors, limitations remain, including selective reporting, subconscious plagiarism, and methodological divergence where AI wrote plausible methods in papers that did not match the actual code.
Related event: Co-Scientist Review: Hallucinations Plummet but Limits Remain(3 posts)→
More from Models
- NVIDIA's Nemotron 3.5 Super VL hits CoreWeave: 12B-active multimodal MoE at $0.25/M input tokens — wandb · 2026-10-16
- Opus 5 might be a very deep model or use looping, commentator speculates — scaling01 · 2026-10-16
- GPT-6.1 Sol audit finds 6% of arXiv papers had false main theorems, down to 1.5% recently — nitarshan · 2026-10-16
- Nvidia-backed post-training pushes Nemotron 3.5 VL past frontier on dermatology diagnosis — LoganGrasby · 2026-10-16
- Gemini 4 Argon scores 97.5% on ARC-AGI-3, second lab above 95% — patience_cave · 2026-10-16
- Microsoft MAI claims SOTA 3T-param in-house base models, post-training results coming — soldni · 2026-10-16