NextLat and full-bandwidth transformers structurally enable each other, Langford says
JohnCLangford · x · 2026-10-06
MLB researcher John Langford notes the connection between nextlat and full-bandwidth transformers (FBT) is stronger than one leading to the other: they structurally enable each other when you fold nextlat on top of FBT.
In the quoted context, jaydenteoh recounts that the idea traces back to chats with Langford in November while writing NextLat. His frustration with NextLat: it can teach a transformer the inductive bias of an RNN (or train an RNN without recurrence), but gives the transformer teacher no circuit to escape fixed-depth computation and perform recurrence across time — the goal was to imbue transformers with recurrence without relying on implicit depth.
More from Research
- Virtual cell debate was a metrics problem: Nature Biotech paper says calibrated metrics vindicate perturbation models — anshulkundaje · 2026-10-06
- FlowBank (NeurIPS 2026): precomputed workflow portfolios give agents query-level adaptivity at task-level cost — furongh · 2026-10-06
- Guava open-sources VLM distillation: 2K sim trajectories yield a 4B robot agent at 90% real-world success — furongh · 2026-10-06
- First Oracle PL/SQL benchmark, ported from MBPP/MBPP+, to be presented at EMNLP — srchvrs · 2026-10-06
- EvalEval Coalition on the science of AI evaluation grows to 800+ researchers, adopts new governance — evijit · 2026-10-06
- Calico's Multi-ISM cuts genomic saturation mutagenesis evaluations 45-fold — anshulkundaje · 2026-10-06