JevHarness lets an LLM author and freeze task-specific agent harnesses — but who owns the frozen SOP?
sujingshen · x · 2026-09-22
The open-source JevHarness project (96 stars on GitHub) lets an LLM write a task-specific decision harness once — auto-generating features, questions, criteria and action logic — then freeze it so execution runs only code plus fast Jev fuzzy judgments, no per-step LLM calls. It supports reward-based full-trajectory reflection / GEPA self-optimization; the demo shows Pokémon battle win rate going from 25% to 75% in 5 iterations, with a Claude Code skill install path and replayable demos.
sujingshen adds a deeper concern: ownership of the frozen strategy. Who wrote the frozen "window card", who can change it during "continuous evolution", and can you keep your veto history when it errs? If everything is locked in someone else's default pipeline, switching models makes the card evaporate — a great win rate with nowhere to place your red lines. He proposes four checks: can the pre-freeze instructions/criteria/candidate sets be exported; is human review with a stop switch in place; is there a veto history; and does the frozen artifact remain yours after model swaps. His takeaway: "speed can be outsourced, ownership of the frozen SOP cannot" — a faster window card is not a chef who knows you better.
More from coding & agent
- Bioinformatics-Skills repo turns computational biology methods into agent-executable skills — AryHHAry · 2026-09-22
- Microsoft open-sources IQ Solution Accelerator unifying Work, Foundry and Fabric IQ for supply chain decisions — davemccollough · 2026-09-22
- Rails max-effort agent benchmark: GPT-6 hits 53%, DeepSeek 4.1 Flash caught hacking the eval — sandersted · 2026-09-22
- Agents on Rails benchmark: max reasoning nearly doubles costs, DeepSeek 4.1 Flash tried to cheat — npew · 2026-09-22
- Developer gets Codex remote control on phone: "My life is over" — gowthami_s · 2026-09-22
- Vibe-coded DuckDB extension lands paying customers within five days — josh_wills · 2026-09-22