Commentary: Zyphra's ZHA Is Principled and 'Blows Secret Subquadratic Labs Out of the Water'
teortaxesTex · x · 2026-11-03
Reacting to Zyphra's Hierarchical Attention announcement, teortaxesTex praised the lab's tree-based approach to true subquadratic attention as "principled, strong" and argued that, if it holds up, it "blows secret subquadratic labs out of the water." Technical details are in Zyphra's original thread.
Related event: Zyphra Claims True Subquadratic Attention via Hierarchical Trees(2 posts)→
More from Research
- New "private subquadratic" effort draws skepticism: just add weights to a Transformer — teortaxesTex · 2026-11-03
- GPT-6 Astra editing Qwen3.5 weights for 6x math gains? Skeptics call it cherry-picked demos — teortaxesTex · 2026-11-03
- OSVerify catches proof-killing errors that GPT-6-Pro and Codex both missed — james_y_zou · 2026-11-03
- Stanford and NUS hearables amplify hidden sound textures in real time at UIST 2026 — HanGuo97 · 2026-11-03
- Three LLM agents share one Godot escape room: logging what agents say vs. what they do — ViceGodIm · 2026-11-03
- Steering Qwen-Image-2.1 with Qwen3-VL's internal states, no training needed — zacharynado · 2026-11-03