Not all state tracking is beyond transformers — only the NC1-complete kind
lambdaviking · x · 2026-11-04
Clarifying the theory: transformers can't represent the hardest (NC1-complete) forms of state tracking, but simpler state-tracking tasks fall within TC0 and already resemble tasks in existing LC benchmarks. The popular claim "transformers can't state track" is too coarse — the capability boundary is layered by task complexity.
More from Models
- GPT-6.2 spotted: New OpenAI model rumors point to "astra" incoming — udmrzn · 2026-11-04
- Larger tokenizers suffer more multi-epoch regret, small vocabs survive repeats — SonglinYang4 · 2026-11-04
- Anime image forensics tool foidfinder detects character mashups and booru tags — AlpinDale · 2026-11-04
- Sonnet reportedly behaves with a different personality on Medium vs Max tiers — AaronBergman18 · 2026-11-04
- Mystery Stealth Model Crouton Alpha Free for a Week With 1M Context; Guessed to Be Meta's Wonder Successor — imjustnewatai · 2026-11-04
- Particle-1 lands in OpenClaw with ~45% fewer output tokens than DeepSeek V4.1 Flash — garrytan · 2026-11-04