Maven Clinic Says Real Users Reshaped Its AI Assistant After a 10x Usage Surge
hugobowne · x · 2026-07-25
In a Maven Clinic podcast conversation, the team explains how real users changed the roadmap for its production AI assistant.
Key points
- The assistant launched with only 20% of users able to access it at first.
- Maven originally used it to help people find providers and book appointments, but 50%–60% of early conversations turned out to be basic health questions.
- Four months later, the assistant is available to everyone, benefits answering has shipped, and weekly conversations have grown about 10x.
- Production usage exposed where the team needed better guardrails, better source documents, and better evals.
Why it mattered
- Real user behavior forced the team to rethink what the assistant should do.
- Failures in production became new tests.
- Better models exposed broken eval assumptions rather than simply making the product look better.
The post says the podcast includes a discussion with William about what changed and what he would build differently now.
More from Companies & People
- Investor argues Palantir-Nvidia partnership should slash Anthropic's IPO valuation — pdamodaran · 2026-09-11
- PyTorch Day Korea 2026 launches first offline conf, CFP closes Sept 13 — PyTorch · 2026-09-11
- Class action accuses Anthropic of overselling Claude subscriptions with deceptive usage multipliers — The Decoder · 2026-09-11
- AI post-training and evals jobs pay up to $850K, with median offers at $210K–$325K — FinanceYF5 · 2026-09-11
- 89% of firms use AI, only 6% see significant ROI — the busywork illusion — mikeflache · 2026-09-11
- a16z partner flips to call for nationalizing frontier AI labs, sparking debate — S_OhEigeartaigh · 2026-09-11