John Langford weighs in on FBT note: fixed-point convergence and quantized caching

JohnCLangford · x · 2026-11-22

Vowpal Wabbit creator John Langford comments on xidulu's FBT technical note, which addresses fixed-point iteration convergence, speculative decoding via 3-pass verification with pipelining and rollback, and quantized hidden-state caching to cut inference memory. Langford asks why not cache everything in 16 bits and suggests amplifier-model sensitivity may come from pass 1 not being conditioned for pass 2; overall he finds it great work.

Original post →

More from Infra

Infra channel →