Smart glasses test: Octen search at 60ms, model generation is the bottleneck; Mercury 3 wins

Scobleizer · x · 2026-10-20

KZouAPT shared latency tests from building a Sense API for smart glasses: Octen search took a median of 60ms, with model generation as the real bottleneck. Among fast models tested, Mercury 3 delivered the best speed-quality balance, with 0.9s median generation and 2.2s end-to-end response. Context: Stefano Ermon announced Mercury 3 as the most intelligent diffusion LLM released to date, outperforming GPT-6 Luna and Haiku 5.5 on quality while running at 1000+ tok/sec.

Original post →

More from Embodied

Embodied channel →