Ramen open-sources eval gates and guardrails for shipping MCP tools like code

Ok_Plum3595 · reddit · 2026-11-18

Ramen (BSD-3, self-hosted) treats MCP tools like code with a release process: drop a promptfoo eval config in the repo so every deploy runs against a canary and a failure blocks rollout ("no eval, no deploy"); NVIDIA SkillSpector scans repo skills plus one synthesized from what the zone actually serves; NeMo rails (selfcheckinput, jailbreakdetection, topical, hallucination) run per-tool through a judge proxy so provider keys stay on the console; client configs (CLAUDE.md block, Cursor rule, settings) are versioned and every call must carry the accepted version. Supports MCP 2026-07-28: tasks, multi-round-trip/elicitation, MCP Apps, Skills over MCP. Built largely with Claude Code agents.

Related event: Ramen: Open-Source Team MCP Platform with Eval Gating(2 posts)→

Original post →

More from coding & agent

coding & agent channel →