Coding agents fail to reimplement models from papers, sparking doubts about how papers are written
charlieharris01 · x · 2026-10-29
rkrishna3 expressed surprise that the latest coding agents couldn't reimplement the models from papers, suggesting something may be missing in how papers are written. Quoting the thread, charlieharris01 called it great evaluation work by the team at @AISecurityInst (AI Security Institute) and linked the paper. The finding uses agent capability as a lens to expose gaps in reproducibility of academic writing.
More from coding & agent
- GitHub Copilot adds image generation in public preview, powered by GPT Image 2.5 Flare — caolonghua · 2026-10-29
- Anthropic surfaced 29,000+ Node.js bug candidates in six months; fixing is now the bottleneck — dscape · 2026-10-29
- Six months later nobody remembers why: Reddit debate on architecture decision records — djgoel123 · 2026-10-29
- Auto-Company: open-source firm of 14 AI agents runs 24/7 with one markdown file as memory — JafarNajafov · 2026-10-29
- One rule for posting agents: never auto-retry a failed publish — petrusenko_max · 2026-10-29
- Explosion ships agent-ready NLP project templates that cut pipeline cost 20x — _inesmontani · 2026-10-29