Coding agents more than double every released speculative decoding system, DFlash2 hits 10.87x

berkeley_ai · x · 2026-11-04

SpecPilot: given GPUs and one rule — stay lossless — coding agents improved every released speculative decoding system tested, with DFlash2 going from 4.46x to 10.87x over AR decoding, no training required. The team also introduced a lossless 12-bit format whose GEMM beats cuBLAS. The authors argue MLSys is in a golden age: agents are now capable researchers and low-hanging fruit abounds at the token level.

Original post →

More from coding & agent

coding & agent channel →