SpecJudge v0.2.0: Forcing LLMs to Cite Real Evidence Fixes Total 8B Model Breakage

jokiruiz · reddit · 2026-08-06

Open-source CLI tool SpecJudge released v0.2.0, designed to recommend the most cost-effective AI models based on project specs. The core update forces the LLM judge to cite actual text fragments supporting its ratings, preventing the model from using fluent narratives to mask incorrect assessments.

While building regression tests, the developer discovered a critical bug: 8B parameter local models failed across all test projects. The root cause was that Ollama's format: json guarantees valid JSON but not the specific JSON structure requested, leading models to output [true] instead of a citation ID. By enforcing a strict JSON Schema, the success rate jumped from 0/9 to 9/9. Additionally, the new version pins sampling parameters to ensure reproducible evaluation results.

Original post →

More from coding & agent

coding & agent channel →