kalomaze: cross attention is what you add when you iterate on architecture more than data
kalomaze · x · 2026-11-17
kalomaze quipped that cross attention is what you add to an architecture when you iterate on architecture choices more than on data design — a jab implying that data design deserves far more attention than architectural embellishment.
More from Research
- Mental navigation proposed as the brain's default computational mode — abenitezburraco · 2026-11-17
- Judea Pearl praises a one-slide explainer of how structural causal models turn causation into math — yudapearl · 2026-11-17
- What 4 calibration papers do (and don't) say about gating agent tool calls on model confidence — Xjjjjyn · 2026-11-17
- ICLR 2027 rebuttal catch-22: new experiments deemed "too much change," rebuttals dismissed as "AI slop" — SimpleObvious4048 · 2026-11-17
- IIT Madras CeRAI unveils conversational AI eval tool with 7 dimensions, 48 core metrics — ravi_iitm · 2026-11-17
- Are top AI conferences failing? High-quality authors may be dropping out — analisereal · 2026-11-17