ByteDance EdgeBench: Evaluating AI Agents' 10-Hour Self-Iteration Capabilities
karminski3 · x · 2026-07-06
ByteDance's Seed team released the EdgeBench evaluation framework, designed specifically to assess AI agents' ability to autonomously iterate and improve over long horizons (up to dozens of hours) in a real, runnable environment. Unlike single-task evaluations, it focuses on whether an agent can leverage environmental feedback, adjust strategies based on failures, and continuously enhance performance.
The tester used a locally run 35B-A3B model (4-bit quantization) to tackle the classic Roguelike game DCSS (command-line version). The task required the Agent to write Lua bot scripts via CodeX CLI to automatically explore, fight, and descend levels within roughly 70 minutes. The initial automated score was 15.2, which improved to a maximum of 33.4 after multiple iterations, clearly showcasing the AI's true learning trajectory in long-horizon tasks.
Related event: ByteDance Releases EdgeBench to Evaluate Long-Horizon Agent Evolution(4 posts)→
More from coding & agent
- Agent Field Kit launches $29 security runbooks for production AI agents — alvelda · 2026-10-27
- Cloudflare Durable Objects validated as top architecture for AI agent WebSocket servers — tristanbob · 2026-10-27
- GitHub Next's Chopin prototype explores real-time multiplayer agentic planning — max__drake · 2026-10-27
- Veynod: An Open-Source Shared Workspace Where AI Agents Collaborate Like a Team — TKOWNS · 2026-10-27
- TMLR paper: enforced thinking doesn't reliably make LLM agents disclose key info to users — SharonYixuanLi · 2026-10-27
- LLM-written Rust library bbtree verified: speed claims hold, memory savings reverse — lmoroney · 2026-10-27