Alleged 2021 Anthropic doc shows 1T-parameter models, RL, scaling laws all planned early
akbirthko · x · 2026-10-15
An alleged July 2021 Anthropic internal document (authenticity unverified) is circulating on X. It already discussed training 1T-parameter models with RL, hardware risks (TPUs, Trainium), building datasets from language/code/diffs/PRs, coding tools, scaling laws, reward models, test-time compute, long context, memory, and RL for tool use. Commenter akbirthko notes that if you truly believed in 2021 these models would do labor over an API, such plans follow logically — but seeing every idea in one 2021 document still startles, showing Anthropic's AGI roadmap thinking predates its public narrative by years.
Related event: Anthropic's 2021 Research Roadmap Surfaces via Copyright Lawsuit(7 posts)→
More from AGI Musings
- AI Slop Is Flooding Comment Sections, Pushing Creators Toward Gated Communities — alliekmiller · 2026-10-15
- Brin says Gemini 4 puts Google on the 'RSI treadmill'; critics demand hard data — daveholtz · 2026-10-15
- UCLA paper: productivity tech like AI can trigger a workplace "rat race" that hurts welfare — soumitrashukla9 · 2026-10-15
- AI-pilled veteran pushes back: diagnostics aren't the bottleneck, unrecorded clinical knowledge is — gregmushen · 2026-10-15
- Analysts see US labs far ahead at the AI frontier; China's next leap expected Q2–Q3 2027 — teortaxesTex · 2026-10-15
- Survey: apathy, not privacy, is the real barrier holding back consumer AI adoption — omooretweets · 2026-10-15