Researcher claims linear attention is pure sunk-cost fallacy and will never work

jm_alexia · x · 2026-08-18

A blunt take: linear attention exists only out of sunk cost fallacy, memory can't be patched and will never work—the right path is to study how the brain develops and copy its design. Thinly argued, but it stirs debate over attention architecture directions.

Original post →

More from Models

Models channel →