RLI Eval: AI Automation Rate Jumps from 2.5% to 16.1% in a Year
sebkrier · x · 2026-07-05
An evaluation tracking AI automation capabilities (RLI) shows the best automation rate has risen from 2.5% to 16.1% since launch. However, AI still falls short of professional quality on most projects—none of the three tested Fable 5 deliverables could be accepted as final products. Despite this, the automation rate has improved rapidly in less than a year.
More from coding & agent
- A 9B Ollama agent can run a fully local DJ radio with tools, memory, and TTS — pinku1 · 2026-07-27
- Bugbot rejects an MCP permission flag because it would break path-scoped isolation — zeeg · 2026-07-27
- One GPT-5.6 agent is guarding a Blink security system while another makes a parody rap album — repligate · 2026-07-27
- An agent got unblocked by reusing a logged-in browser, not stealth tricks — armanidev_ · 2026-07-27
- Paper argues graph topology can become the core operating system for AI agents — theomitsa · 2026-07-27
- Claude Code desktop adds UI markup feedback for smoother visual editing — EricBuess · 2026-07-27