CODA-BENCH Evaluates Code Agents
jiqizhixin · x · 2026-07-12
A research team from Renmin University of China released CODA-BENCH, designed to simultaneously test coding capabilities and data intelligence.
- Task scenarios require agents to navigate complex file systems, hundreds of Kaggle datasets, and complete real-world data analysis coding tasks.
- Results show that even top-tier systems only achieved a success rate of 61.1% across 1,009 tasks, indicating that current agents still have significant shortcomings in data-intensive work.
- The post includes links to the project, paper, code, and dataset, along with a report from Jiqizhixin.
More from coding & agent
- WanGP adds one-click AMD GPU support for Tencent's Hy-Nomas world model, runs on 8GB VRAM — cocktailpeanut · 2026-10-27
- He benchmarks new models by having them build their own copilot — $28 of compute — bucolucas · 2026-10-27
- Founder generates 46 app promo videos in 4 days with Claude, skipping $11,500 in UGC fees — PrajwalTomar_ · 2026-10-27
- Should agents be allowed to change plans mid-task? Reddit debates the drift boundary — wistfulcracker84 · 2026-10-27
- HeyGen + Canva MCP turns slide speaker notes into an avatar presentation video — HeyGen · 2026-10-27
- Local beats cloud: Qwen 3.8 FN handles private student data as well as frontier models — dr_lm · 2026-10-27