Scope benchmark: only 16.6% of 1,035 AI agent attempts can sign up for hosted databases
RaphaelDabadie · x · 2026-11-07
Scope tested 18 hosted database providers with 20 model-agent combos (Claude Code, Codex, Cursor) over 1,035 sessions on the task of signing up, creating a database, writing a record, and handing over credentials. Only 16.6% reached a working result, with failures driven by captchas, bot blocks, OAuth-only flows, and rejected agent emails. Prisma Postgres led at 88.3%, followed by Upstash (63.3%), Neon and Nile (43.3%); six providers including Xata, SingleStore, Convex, and CockroachDB let in zero agents. The report argues databases are losing agent-driven revenue and proposes fixes for agent-hostile signup flows.
More from coding & agent
- Claude accidentally does recursive skill improvement, spawning sub-agents to A/B its SKILL.md — holdenmatt · 2026-11-07
- LLM agent re-architects models during training: algorithmic reasoning 55%→84%, AIME 64%→71% — lateinteraction · 2026-11-07
- AI won't replace designers: a deep dive into the Quest team's AI iOS design workflow — JiliJeanlouis · 2026-11-07
- Developer stumbles into an accidentally recursive SKILL.md that tests itself — holdenmatt · 2026-11-07
- Anthropic details agent memory: "dreaming" helps Claude fix mistakes and organize knowledge — RLanceMartin · 2026-11-07
- TechSEO Connect talk: write SOPs as skills and use small commits when vibe coding — lilyraynyc · 2026-11-07