Third-party test: Thinking Machines' Inkling 2 Small jumps to 32% on Real-SWE, 4x its predecessor
keirp1 · x · 2026-11-14
Third-party team Specific benchmarked Thinking Machines' Inkling 2 Small on Real-SWE 1.1: the resolution rate jumped from Inkling 1 Small's 8% to 32% — a 4x improvement. The reposter calls it "one of the best American open source foundation models."
Note this is a third-party benchmark rather than official numbers, but the jump is substantial and worth tracking as Mira Murati's Thinking Machines continues its open-source push.
More from coding & agent
- OpenAI $200 plan drops to $100 on Nov 20; user races to burn 4 banked Codex resets — koltregaskes · 2026-11-14
- Tonbi ships AI Garage plugin giving agents MCP access to his content catalog — Teknium · 2026-11-14
- Google's Modern Web Guidance lifts coding agents' modern web compliance from 56% to 95% — aigclink · 2026-11-14
- Google's Modern Web Guidance boosts coding agents' modern-web compliance from 56% to 95% — aigclink · 2026-11-14
- Antigravity's /swarm lets agents talk via message board; user says workflow transformed — zacharynado · 2026-11-14
- Unpopular opinion on Reddit: most AI agents are just overcomplicated chatbots — Charming_Cod_2910 · 2026-11-14