Maven Clinic Says Real Users Reshaped Its AI Assistant After a 10x Usage Surge
hugobowne · x · 2026-07-25
In a Maven Clinic podcast conversation, the team explains how real users changed the roadmap for its production AI assistant.
Key points
- The assistant launched with only 20% of users able to access it at first.
- Maven originally used it to help people find providers and book appointments, but 50%–60% of early conversations turned out to be basic health questions.
- Four months later, the assistant is available to everyone, benefits answering has shipped, and weekly conversations have grown about 10x.
- Production usage exposed where the team needed better guardrails, better source documents, and better evals.
Why it mattered
- Real user behavior forced the team to rethink what the assistant should do.
- Failures in production became new tests.
- Better models exposed broken eval assumptions rather than simply making the product look better.
The post says the podcast includes a discussion with William about what changed and what he would build differently now.
More from Companies & People
- Microsoft offers buyouts to 60,000 employees as AI investment shrinks headcount — dinabass · 2026-10-26
- OpenAI unifies ChatGPT, Codex and API release notes into one searchable page with RSS — craigsdennis · 2026-10-26
- Anthropic's top 2 customers fell from 54% of revenue in 2023 to about 21% by 2026 — BenBajarin · 2026-10-26
- diginomica: agentic automation hype is overdone, and 'The Hackening' of enterprise security has begun — jonerp · 2026-10-26
- Ben Bajarin: enterprise AI adoption mirrors early cloud, at magnitudes larger dollar size — BenBajarin · 2026-10-26
- An AI company built in five years now moves a mid-sized European GDP — felpix_ · 2026-10-26