François Fleuret: decoder transformer's elegance — no trade-off hyperparameters
francoisfleuret · x · 2026-11-19
Renowned researcher François Fleuret notes there is something elegant about the decoder transformer having no "trade-off hyperparameters" — a nod to the architecture's unusually clean design with very few knobs to tune compared to other model families.
More from Research
- ETH's Anymal robot completes 10km autonomous alpine hike with VLM-guided ROAM system — ChongZzZhang · 2026-11-19
- OpenVax codebase grows from 78K to 565K lines in 15 months — iskander · 2026-11-19
- New essay makes the case for traditional social science in studying AI agent interactions — RobbWiller · 2026-11-19
- If a model generates valid math blackboards, does it understand math? — francoisfleuret · 2026-11-19
- The Zvi on GTA 6's 99 Metacritic score: 'Welcome to 2026. We need better benchmarks.' — NathanpmYoung · 2026-11-19
- Stanford blood test ages 11 organs from 5,000 proteins; Helios launches 1,000+ biomarker home test — jgooten · 2026-11-19