Coding Agent Index Adds Safety Refusal Metric; Claude Tops at 8.8%

Artificial Analysis opened full results and methodology for its Coding Agent Index v1.5, adding a safety refusal metric; Claude shows the highest refusal rate at 8.8%, helping explain score differences.

2026-09-19 ~ 2026-09-19 · 2 related posts

• Coding Agent Index v1.5 adds safety refusal reporting; Claude Fable 5.1 fallback hits 8.8% — ArtificialAnlys · 2026-09-19
• Artificial Analysis opens up coding agent leaderboard and benchmarking methodology — ArtificialAnlys · 2026-09-19