n8n workflow evaluates LLMs with two cross-provider judges to avoid self-preference

ZtasnimS75 · reddit · 2026-11-19

A developer built and open-sourced an n8n workflow that evaluates an LLM using independent LLM judges:

Key design: neither judge is the candidate model, avoiding self-preference; a judge gap of 2+ points surfaces as an explicit metric. The author notes 5 questions is only a demo — real evals need a bigger labeled set. Workflow JSON, setup and SQL are on GitHub.

Related event: Open-source n8n pipeline uses cross-vendor LLM judges(2 posts)→

Original post →

More from coding & agent

coding & agent channel →