kalomaze slams Anthropic over 'invisible nontransparent harness' in evals
kalomaze · x · 2026-11-14
Well-known open-source developer kalomaze publicly criticized Anthropic for what he calls "invisible nontransparent harness bullshit" in its model evaluations — a direct jab at the opacity of how frontier labs run their benchmarks, which undermines reproducibility and comparability of results.
Related event: Developer slams Claude's invisible sub-calls and opaque eval harness(4 posts)→
More from Companies & People
- Job hunter's trick: fix a real issue in a startup repo, send the PR as evidence — minhnguyen · 2026-11-14
- Bill Ackman Defends Jensen Huang Amid Scandal, Citing a Personal Favor — lifebypixels · 2026-11-14
- Jessica Lessin: 'As Jensen created the AI boom, it created him' — NinaDSchick · 2026-11-14
- Coinbase CEO: merged 46 PRs across 10 repos in 14 days part-time by talking to agents — ycombinator · 2026-11-14
- Switching from global health to AI safety: one grantmaker's candid career reflection — austinc3301 · 2026-11-14
- Commentary: Without Jensen Huang, There'd Be No 'Age of Wonder' — _arohan_ · 2026-11-14