DialogueBench: Gemini Neon edges GPT-6.2 Sol 67.9% vs 64.5% at video dialogue editing

MatthewBerman · x · 2026-11-20

Matthew Berman published the Scarlet Dialogue Eval, a new benchmark testing models' ability to accurately edit dialogue in video, pitting Gemini 4 Neon against Codex GPT-6.2 Sol on a 20-minute talking-head edit (average of 2 runs).

Takeaway: Gemini Neon wins overall and is much faster, but mid-word cuts remain unreliable for both.

Original post →

More from Models

Models channel →