ApprenticeBench: agents learn on the job and surpass human professionals
ysu_nlp · x · 2026-09-11
NeoCognition launched ApprenticeBench, billed as the world's first job-level continual learning benchmark, reframing "long-horizon" from one long task to getting better across tasks — can an agent learn a job through experience?
- Fable 5.1 and GPT-6 Astra reportedly continually learn on a real job and surpass human professionals, which the team calls a decisive step change in AI's job readiness.
- No FDEs: agents deploy themselves into the job.
- The author argues "learning = inference + long-term memory," and that pushing long-horizon far enough leads to lifelong AI where learning and inference become inseparable.
More from coding & agent
- Dev argues MCP is unnecessary: hand agents an API key and they'll get the job done — sull · 2026-09-11
- Dev to add AI-friendly collision checking CLI to OpenSCAD — _Stocko_ · 2026-09-11
- Cadenya: a year-long indie build of an MCP-powered agent runtime — littlebobbyt · 2026-09-11
- xAI team to livestream building a company from scratch with Grok Bot over three days — soleio · 2026-09-11
- ClawOS: an experimental open-source Arch-based OS with OpenClaw as its primary agent interface — heyneighbor · 2026-09-11
- Grok Bot adds Salesforce, HubSpot, Gong connectors plus installable sales-bot templates — XFreeze · 2026-09-11