Inside Zhipu's dense-feedback InfraAgent: an early blueprint for recursive self-improvement
量子位 · wechat · 2026-09-17
QbitAI relays Zhipu chief scientist Tang Jie's technical blog in full, detailing how a GLM-5.3-driven InfraAgent helped build and optimize a production inference system on 100k+ domestic accelerator cards. GLM-5.3-Flash ran anonymously as Ox-Alpha on OpenCode and OpenRouter, handling 62+ trillion tokens in six days.
The core technique is "dense feedback": organizing correctness tests, execution traces, and micro-benchmarks into the Agent's iteration loop, with feedback that is local, timely, and objectively verifiable—solving why end-to-end metrics alone can't explain regressions. Three case studies:
- Correctness: the Agent found TF32 default precision causing error accumulation in KDA context-parallel paths; fixed with tf32x3, merged upstream to FlashLinearAttention.
- System behavior: the Agent traced a Python GIL bottleneck in DeepEP v1.2.1's intranode dispatch/combine blocking MooncakeTransfer threads; after the fix, Prefill+KVTransfer overhead dropped from >20% to under 1%.
- Performance: the Agent distilled "optimization skeletons" from SGLang and FlashLinearAttention, restructured a Decode Kernel to eliminate four redundant normalizations for a 1.71x speedup.
Zhipu stresses RSI hasn't been achieved—humans still set goals, boundaries, and review high-risk changes—but each Agent-completed engineering task may become training data for the next model generation.
More from AGI Musings
- Polymarket puts 36% odds on frontier AI labs agreeing to pace AI by 2026 — Polymarket · 2026-09-17
- A Private WoW Server Would Be the Perfect Sandbox for Testing AI General Intelligence — djcows · 2026-09-17
- A 2008 Story Description Now Reads Like LLM Output: 'Semantic Apocalypse' — erikphoel · 2026-09-17
- OpenAI cracks a math logjam as 25 Fields medalists sign cautionary letter — nordicinst · 2026-09-17
- 'By 2030' AI safety assurances don't reassure, commentator notes — FlorianGallwitz · 2026-09-17
- Nate Silver voices skepticism on RSI, spars with AI class-action plaintiff — dhadfieldmenell · 2026-09-17