FFmpeg's Assembly code is the go-to test for whether LLMs can out-code human engineers

sh4dy_0011 · x · 2026-11-08

A jab in the "show me an engineer who writes better code than an LLM" debate: RomainHedouin suggests picking any Assembly file in the FFmpeg repo and trying to have an LLM reproduce it — implying frontier models still fall far short on hand-tuned low-level SIMD code. Assembly makes up about 8.4% of FFmpeg's codebase and is maintained by a handful of elite human experts, making it a popular benchmark for probing LLM coding limits.

Original post →

More from coding & agent

coding & agent channel →