Microsoft Employee: Harness is 60% of Performance, Models Just 40%
RihardJarc · x · 2026-08-31
A Microsoft AI employee shared insights on model comparisons and industry trends:
- Model Characteristics: Claude excels at complex multi-step reasoning with less rework; OpenAI suits single-step execution but is 20-30% more costly for complex tasks due to iterations.
- Performance: Claude Code's native pairing has a 20-30% higher first-pass acceptance rate than GitHub Copilot, though the gap is expected to close.
- Key Takeaway: Models are becoming commodities; 60% of performance depends on the "harness" (engineering framework), while only 40% relies on the model itself.
- Pricing Trend: The industry is expected to shift from token-based to outcome-based pricing for cost predictability.
- Talent Shift: Junior hiring is down. 65-70% of the dev lifecycle will be autonomous in 3-5 years, making professionals with judgment and agentic skills more valuable.
More from coding & agent
- DIY visual diff tool using GitHub Artifacts and pure JavaScript to save costs — zeeg · 2026-09-01
- Dev shares a dirt-cheap approach to visual diffs — zeeg · 2026-09-01
- Grok Bot automates Shopify updates and supplier coordination — billyjhowell · 2026-09-01
- Grok Bot automates lost deal analysis by mining call and email threads — lennysan · 2026-09-01
- Design pattern: immutable agent artifact revisions behind a stable review URL — RocketSeven · 2026-09-01
- Building a long-term memory benchmark for agents: what to add? — True_Mongoose_7073 · 2026-09-01