Databricks says Genie Code beat three coding agents on 401 tasks at $0.55 each
matei_zaharia · x · 2026-07-26
Databricks says better data agents can improve accuracy and efficiency at the same time.
In a head-to-head test on 401 real internal data tasks, Genie Code was compared with three leading general-purpose coding agents. Each agent used its own harness, frontier models, Databricks MCP, and the same 20-minute task budget.
Reported results:
- Accuracy: 76.6%, the highest of the group
- Mean cost: $0.55 per task, the lowest of the group
- Relative cost: less than half the cost of the other agents
The company says the edge came from context handling: semantic search, persistent memory, and workspace understanding reduced random exploratory wandering and helped agents arrive at the right answer faster.
Related event: Databricks Claims Genie Code Beats Coding Agents at $0.55/Task(2 posts)→
More from coding & agent
- Team demos AI agent Blender skills with impressive 3D results — noahsolomon · 2026-10-26
- A 13KB Markdown file can hijack Claude Code and Codex via your Downloads folder — pbaylies · 2026-10-26
- A Fallback for an Auto-Posting Bot: Silence Is the Default, Posting Is the Exception — petrusenko_max · 2026-10-26
- Claude Code can now edit videos: a 10-prompt workflow from raw footage to final cut — TawohAwa · 2026-10-26
- Developer Moves All Prompts to Skills: AI Coding Workflow v3 Explained — rseroter · 2026-10-26
- charlie Marsh: rewrites beat external deps in the AI era — mohamedmansour · 2026-10-26