NEO-VLA: 2B native VLM on raw pixels hits 95.3 avg on LIBERO, beating Qwen3-VL and Gemma-3

liuziwei7 · x · 2026-11-06

NEO-VLA feeds raw pixels via a tiny conv patchifier into a 2B native VLM (NEO-2B, 40 layers) plus a flow-matching action expert with shared t-RoPE offsets (26D arm + 8D body actions). On LIBERO (30k-step checkpoint, 2000 episodes) it reaches 95.3 average success with full fine-tuning, beating 4B Gemma-3 (91.0) and 2B Qwen3-VL (90.8); frozen it already scores 90.9. Layer-wise results suggest the backbone's early layers act like a vision encoder — raw-pixel native input can beat VLM + vision encoder setups.

Related event: NEO-VLA: Native Vision-Language-Action Policy Without a Vision Encoder(3 posts)→

Original post →

More from Embodied

Embodied channel →