Context layers don't violate the bitter lesson — search is half the point

verrsane · x · 2026-11-22

Eddie Zhou argues context/semantic layers aren't counter to the bitter lesson: search is half of Sutton's point. Like b-trees surviving faster CPUs, even 0ms inference leaves you I/O-bound when fanning out across SaaS APIs — and proprietary state means those API pipes only narrow. The fix: a local read replica plus derived indexes built by offline LLMs, with slow incremental sync instead of runtime parallel search. Quoted tweet calls this "lap 2 of prompt engineering."

Original post →

More from AGI Musings

AGI Musings channel →