Dev observation: models excel with a reference implementation, but struggle at designing something truly new
lucasmeijer · x · 2026-10-17
Developer lucasmeijer notes a clear capability divide: when there's a large amount of work but a reference implementation to follow, models perform impressively; but when asked to design or build something genuinely new, they fall far short. He describes the gap between the two scenarios as "an ocean."
More from AGI Musings
- Train AI on phonebooks and transactions — no weekdays, colors or cats emerge — gerardsans · 2026-10-17
- AI systems are just compression and sampling — no physical reality in strings — gerardsans · 2026-10-17
- MIT professor proposes "living scientific records" for decentralized multi-agent discovery — ProfBuehlerMIT · 2026-10-17
- Dev got 10x easier, marketing 100x harder: founders clash over AI's net effect — MarcJSchmidt · 2026-10-17
- "In a decade most deeptech will look like a grift" — and the sad agreement it draws — sachdh · 2026-10-17
- Open-source maintainer asks: what's the incentive to release anything open-source now? — MarcJSchmidt · 2026-10-17