kalomaze: assuming a step-change that requires dropping attention is even more exotic
kalomaze · x · 2026-11-03
kalomaze continues his rebuttal: the original argument assumes a radical step-change improvement exists that specifically benefits from removing attention — an even more exclusive and exotic category than step-change improvements themselves, which are already rare.
More from Research
- Tsinghua spinoff Apex Intelligence open-weights Apex-35B, built by automated AI research system — jiqizhixin · 2026-11-03
- Platonic Representation Theorem questioned: positive-pair choice embeds worldview assumptions — AnnaCiaunica · 2026-11-03
- Microsoft's MAI-DxO hits 83% diagnostic accuracy on 304 NEJM cases vs 36% for physicians — jiqizhixin · 2026-11-03
- Google releases EmbeddingGemma 2 paper: unified multimodal embeddings beating models 12x larger — osanseviero · 2026-11-03
- Reviso: agentic video captioning that prioritizes key visual evidence (PKU, KlingAI) — Tengfei Liu · 2026-11-03
- Stanford benchmark finds top AI agents score only 82.2/100 as teammates — StanfordUniversity · 2026-11-03