Tang Jie on LLMs: Post-Training is More Crucial
dotey · x · 2026-07-18
This repost summarizes Tang Jie's extensive thoughts on LLM development in 2025. The core message: pre-training remains important but is no longer the only protagonist; what truly determines a model's real-world applicability is mid-to-late stage training that activates capabilities for long-tail scenarios and practical tasks.\n\nHe also makes a strong assertion: the first principle of AI applications shouldn't be "building new apps," but rather "replacing human labor." Following this logic, when building applications, one should prioritize identifying which roles and workflows are best suited for AI takeover, rather than just chasing superficial product innovation.\n\nThe post also emphasizes that many current models have become "over-specialized" just to ace benchmarks, making them unstable in complex real-world scenarios. Consequently, post-training, alignment, and training oriented towards real-world tasks will become increasingly critical.
More from AGI Musings
- Token quotas are reshaping how builders work, sleep, and recover — mobileraj · 2026-07-21
- NBER talk will present new evidence on how organizations use ChatGPT — daveholtz · 2026-07-21
- Writing for AI: When LLMs Become the New Audience for Online Content — IvyTatiana88 · 2026-07-21
- AI may push resistant tech workers toward union bargaining — Chobeat · 2026-07-21
- Jacob Tsimerman interview frames LLMs as a turning point for mathematical discovery — stevenstrogatz · 2026-07-21
- London is getting an AI-adjacent optimism picnic in Hyde Park on September 5 — isnit0 · 2026-07-21