MirrorCode: Evidence AI can handle coding tasks taking weeks
141_1337 · reddit · 2026-08-17
Early results from MirrorCode, a benchmark co-developed with METR for long-horizon coding tasks, reveal that AI models can autonomously reimplement complex existing software without source code, provided there is a detailed specification.
- Case: Claude Opus 4.6 successfully reimplemented gotree, a bioinformatics toolkit with 16,000 lines of Go and 40+ commands.
- Efficiency: Estimated to take a human engineer 2–17 weeks without AI assistance.
- Trend: Continued gains from inference scaling suggest these long-horizon tasks are solvable with sufficient compute.
More from coding & agent
- Homelab owner lets an AI agent run his network, approving only the 'risky changes' — Rasmic · 2026-10-16
- Maker wires Grok and Claude into ROS2 robot with RealSense stereo cameras — chrismatthieu · 2026-10-16
- MIKE: open-source kanban agent harness with gVisor sandboxing and local-model support — SoftwareRenderer · 2026-10-16
- Meta open-sources Muse Spark Open agent model with day-0 TPU support in SGLang — BanghuaZ · 2026-10-16
- Saying "load-bearing" in your prompt makes Opus 5.5 stop holding back — zacharynado · 2026-10-16
- You.com partners with Paperclip to give every agent live web access — PolarBearby · 2026-10-16