d1-Omni proves a strict VLM judge, rejecting bboxes accepted by Gemma and LFM2.5-VL
mervenoyann · x · 2026-11-17
The author used d1-Omni as a judge in a VLM-as-a-judge pipeline to audit bbox labels from Qwen. It rejected (p<0.5) boxes previously accepted by LFM2.5-VL and Gemma-4, and shows higher agreement with human annotations. Screenshots show traffic-sign cases with acceptance probabilities mostly below 0.5.
More from Models
- Claude Code Power User Burns 53% of Weekly Limit in Two Days, Downgrades to Sonnet — Inevitable_Truth_85 · 2026-11-17
- SenseNova Loop 9B Claimed to Match Qwen3 27B at 9B Params, GGUF Coming — MeinDruckerSpinnt · 2026-11-17
- SenseNova-Loop-9B Lands on Hugging Face, Claiming 27B-Class Performance — Marcuss2 · 2026-11-17
- AA-PersonalityBench ranks Gemini 4 Argon most metaphorical model, GPT-3.5 Turbo least — ArtificialAnlys · 2026-11-17
- Counterfactual benchmark shows 11 frontier models fail to grasp programming semantics — jessyjli · 2026-11-17
- Harness Adapters: RL-trained LoRA lifts Qwen3.8-27B on Pi from 29% to 63% on SWE-bench Pro — LysandreJik · 2026-11-17