comma.ai breakdown: BF16 output layers created 0.125 m/s speed staircases in driving plans

yassineyousfi_ · x · 2026-09-21

comma.ai's blog post reviews ML bugs that broke its self-driving stack. One key bug: running the plan output head of a DiT world model in BF16 meant speeds near 30 m/s were representable only in 0.125 m/s steps, and the acceleration computation (differencing nearby predictions over a short Δt) amplified the rounding error. The fix: promote the plan head and its inputs to FP32 before running—casting the finished plan to FP32 just yields the staircase with more decimals. The post frames these bugs against the Linux kernel's 0.5 bugs per 1,000 LOC and how to catch such issues earlier.

Original post →

More from Embodied

Embodied channel →