Microsoft Researcher Highlights 4 New AI Papers: 4-bit Training & Data Scaling
JohnCLangford · x · 2026-08-03
Microsoft researcher John Langford shared four recent AI research papers:
- ReOPD: Multiplies effective experience for learning by using teacher prefixes of a policy.
- K3: Introduces significant architectural innovation, notably attention residuals.
- ReQAT: Enables 4-bit training through a carefully studied conjunction of techniques, resulting in large speedups.
- Datamixing scaling laws: Explores the mechanics and understanding of datamixture scaling.
Related event: Microsoft Researcher Highlights Cutting-Edge AI Training Papers(2 posts)→
More from Research
- CriPO: Self-Distillation RL Method Halves Optimization Steps — Mingxuan Xia · 2026-08-03
- Transition-Factorized LAM Paper Updated with New Experiments — ceciletamura · 2026-08-03
- Discussing Hallucination Risks and Limitations of LLMs in Bibliography Retrieval — deliprao · 2026-08-03
- AI Independently Derives General Relativity and Solves Decades-Old Math Problems — elonmusk · 2026-08-03
- Microsoft Exec Laments Top AI Conference Crisis: NeurIPS Paper Quality Drops — MParakhin · 2026-08-03
- FrontierMath Introduces Mathematician Ratings to Help Assess AI Capabilities — Jsevillamol · 2026-08-03