Open-source Flowstore turns LLM system prompts into regression tests
tap3k · reddit · 2026-07-23
What Flowstore is
- An open-source toolkit for teams whose agent behavior is mostly defined in a system prompt and is hard to visualize or debug.
- It converts a system prompt into a structured spec (open JSON Schema, Apache 2.0).
- It includes a visual graph editor so non-prompt engineers can work on it.
- It also ships a Python harness that runs persona-driven simulated conversations with assertions, so prompt changes can be regression-tested before shipping.
What it does not cover
- It is scoped to conversational behavior: logic, guardrails, and data capture.
- It does not test the voice layer, such as ASR, latency, or barge-in.
Pilot program
- The author is looking for 3–5 pilot teams with a live or near-live agent.
- He will help spec the prompt and set up a test suite for free, asking for about 30 minutes per week.
- In return, he wants blunt feedback and offers to name pilot partners as collaborators in the research and Cornell course materials.
More from coding & agent
- Multiple LLMs on one project start treating collaboration structure as a core feature — repligate · 2026-07-23
- Blocks says its agent-friendly UI system is nearing real-time on-brand generation — round · 2026-07-23
- Codex needing iTunes access becomes the latest AI agent meme — KarelDoostrlnck · 2026-07-23
- At Dwarkesh Unplugged, everyone seemed to be prompting their agents — henloitsjoyce · 2026-07-23
- A vibe-coded game makes you shoot surveillance cameras to get home — film_girl · 2026-07-23
- A developer built an OpenClaw-style agent with EveDev and deployed it on Convex — Rasmic · 2026-07-23