Macaron V1 Venti posts strong agent and coding benchmark scores across the board
teortaxesTex · x · 2026-07-22
Macaron V1 Venti is shown beating or matching several larger models on a benchmark table across chat, agent, coding, and UI tasks, with particularly strong scores on PinchBench, TerminalBench 2.1, and UI4ABench.
The post argues that Chinese models are still undertrained and short on RL, so relatively modest post-training can still push them further. It also says this should lower confidence in the usefulness of large-scale distillation alone.
Notable scores in the image
- ChatBench: 58.3
- LivingBench: 64.0
- PinchBench: 94.0
- TerminalBench 2.1: 87.6
- DeepSWE: 58.4
- UI4ABench: 87.8
More from Models
- Sol61 flunks instruction-following: skips mandated research even when explicitly told — lucasmeijer · 2026-10-26
- Kimi K3.1 Pro tops MathArena open models, closing frontier gap to about 6 months — teortaxesTex · 2026-10-26
- Ruff creator Charlie Marsh: frontier models find infinite bugs in any software — charliermarsh · 2026-10-26
- Dev testing one skill across Opus 5.5 and Sol 6.1 finds instruction following 'all over the map' — lucasmeijer · 2026-10-26
- supermemory unveils learner-1, claiming continual learning for any model — julianweisser · 2026-10-26
- Anthropic says Opus 5.5 cuts cost per task by ~40% vs Opus 5 — taufiqintech · 2026-10-26