Structured Output ≠ Usable Results
mattjcoles · reddit · 2026-07-14
This article discusses how structured output only guarantees the "shape," not the "content", and therefore cannot be directly used to decide whether to merge code.
The author's approach involves layering multiple components:
- Using Pydantic AI on Bedrock for structured output
- Using Pydantic evals for evaluation
- Pairing it with a calibrated LLM judge
The goal is to turn model outputs into results that can genuinely "gate merge," rather than merely checking if the JSON format is correct.
More from coding & agent
- Cognition's SWE-2 uses a KKT duality argument in RL to shift the effort Pareto curve — YouJiacheng · 2026-09-11
- First-ever Three.js Conference lands in Paris, with a panel on AI-shortened design workflows — OdinLovis · 2026-09-11
- Data engineering, not agent frameworks, is the real bottleneck for enterprise AI agents — dhruv2038 · 2026-09-11
- RTK Terminal Compression Cuts Tokens but Leaves Your AI Coding Bill Unchanged — Bartaseth · 2026-09-11
- GPT-6 Astra beats Factorio with enemies in 44 in-game hours at ~$4,500 API cost — liminal_bardo · 2026-09-11
- Investment Analyst Asks How to Build a Claude-Based Diligence Agent Stack — Careless_Tie2286 · 2026-09-11