LoL architecture reorders its own forward pass at runtime, mimicking algorithmic composition
micahgoldblum · x · 2026-11-04
micahgoldblum presents an 11-post thread on a new architecture that re-orders its own forward pass at runtime, unlike LLMs where every input traverses identical layers in the same order. Trained on mixed safe/unsafe web text without labels, a linear probe on the router separates the two with up to 0.95 AUROC.
More from Models
- DeepSeek quietly launches "DeepSeek Harness" YouTube channel, hinting at plugin-based agent framework — gnukeith · 2026-11-04
- Reddit user seeks uncensored local model that runs on a weak PC for search and bulk downloads — Emotional_Orange_279 · 2026-11-04
- DeepSeek partial outage fuels speculation compute is shifting to unreleased V4.1 Pro — AccBalanced · 2026-11-04
- Claude hand-writes a 984-param neural net for C syntax highlighting, 5x faster than Pygments — AlpinDale · 2026-11-04
- Fireworks Forge keynote: Sovereign stack, Ember next-gen targeting 30x efficiency, No-GPU — AccBalanced · 2026-11-04
- Kimi K3.1 Pro weights drop tomorrow: 2.8T params, 1M-token context — togethercompute · 2026-11-04