Companies rolling out Claude to everyone get 'just a chat subscription' — missing harness and evals, not weak models
alex_verem · x · 2026-09-15
- Many companies gave everyone Claude licenses this year, but most got little more than a chat subscription.
- One company's sales agent burned through tokens so fast they cancelled and shopped for a cheaper model — misdiagnosing the problem.
- The real issue: no harness, no guardrails, no evaluation set. The model was fine; the engineering scaffolding was missing.
More from coding & agent
- Gemini 4 tops public coding benchmarks but drops to bottom on private tasks — Hesamation · 2026-10-30
- User builds 20-bot Grok suite to track wins, prep 1:1s and close promises — NicoVerderosa · 2026-10-30
- Why 30-year-old BM25 beats vector embeddings for agentic search, per search vet Jo Kristian Bergum — jobergum · 2026-10-30
- LangChain CEO opens Interrupt London with keynote on why orgs should own their intelligence — LangChain · 2026-10-30
- Simlock: open-source control plane gives parallel coding agents their own iOS/Android simulators — Scobleizer · 2026-10-30
- Keyfleet launches open canvas where personal AI agents team up with a shared USDC treasury — seanwbren · 2026-10-30