Company Agent Bench: API models with a simple harness beat agent products
HamelHusain · x · 2026-11-13
philhchen's team released Company Agent Bench, a benchmark for company assistant products, comparing Dots, Grok Bot, Claude Tag, and Devin on how well an agent understands its own company.
Key finding: API models with a simple harness outperform these packaged products. Hamel Husain reacted with "Omg."
More from coding & agent
- Building voice AI: fixing echo, trust, and context — the 25ms self-interruption bug — thechrisperry · 2026-11-13
- Blogger recreates Adobe keynote's video action control in ComfyUI, training-free with MiniMax H3 and LTX — TomLikesRobots · 2026-11-13
- ML professor predicts agents will become compilers between your intent and FLOPs — DimitrisPapail · 2026-11-13
- Solo dev ships IKANDY music visualizer on Steam after months of building with Claude Code — Far-Employee-9531 · 2026-11-13
- Further fine-tuning CLIP with contrastive losses often fails on out-of-distribution data — wightmanr · 2026-11-13
- Meta's Astryx design system lands in v0, ships MCP/CLI for agent component search — iamsahaj_xyz · 2026-11-13