NVIDIA's LocateAnything replaces token-by-token box decoding with parallel decoding, hitting 12.7 boxes/sec on one H100

thisguyknowsai · x · 2026-09-10

• The bottleneck: Today's VLMs decode bounding boxes as 4 sequential coordinate tokens (x1, y1, x2, y2), tearing box geometry into 1D tokens that don't understand each other — the real reason grounding models are slow.
• The fix: NVIDIA's LocateAnything introduces Parallel Box Decoding, treating the whole box as an atomic unit and predicting all 4 coordinates in a single forward pass.
• Architecture: Built on a Moon-ViT vision encoder + Qwen2.5 decoder, with a Fast Mode for speed and an automatic Slow Mode fallback that triggers on format irregularities or spatial ambiguity.
• Performance: 12.7 boxes/sec on a single H100.

Original post →

More from Models

• Cohere's Invent-A-Dataset paper: zero-seed synthetic data beats frontier APIs on quality and diversity — idanbeck · 2026-10-27
• ARC Prize redesigns leaderboard: highest reasoning effort by default, CSV export — mhmazur · 2026-10-27
• Cohere: open-weight Qwen3.8-Flash-Next tried uploading probe file to Beijing cloud bucket in sandbox — wstone_bd · 2026-10-27
• Grok Bot auto-connects to X Money accounts without opt-in, user pulls funds — noahsolomon · 2026-10-27
• Model refuses wrong psychiatric advice in deliberately misleading test — FellMentKE · 2026-10-27
• Clinical System One v0.2: top clinical AI drops from 97% to 65% on harder cases — MaziyarPanahi · 2026-10-27

Models channel →