LFM3-VL-2B scores just 7% non-hallucination rate, confusing a deadly mushroom for food

crusaderky · reddit · 2026-11-18

A Reddit user flagged that Liquid AI's LFM3-VL-2B (a phone-runnable vision model) scores an alarming 7% non-hallucination rate (1 - hallucination rate) on Artificial Analysis's AA-Omniscience v1.1 benchmark — dead last in the comparison chart, where LFM3-1.7B hits 92%, Nanbeige4.3-33B 82%, and Qwen3.8 27B 71%.

Real-world failures cited: identifying the deadly amanita phalloides as a tasty mushroom recommended for risotto, and reading a "trespassers will be shot" sign as "no photos beyond this point." The poster asks for first-hand confirmation of the scores.

Original post →

More from Models

Models channel →