kalomaze Calls Gemma 4 12B a Beautiful, Underappreciated Model With Fully Linear Multimodal Embeddings
kalomaze · x · 2026-09-28
kalomaze praised Gemma 4 12B as a "beautiful/underappreciated" model:
- Its multimodal embeddings are fully linear/standardized, with a clean architecture.
- It is reasonably deep, and at 12B the dense (vs MoE) choice still makes sense, unlike around 30B.
- His verdict: whatever you think of Google's RL, their pretrains are elite.
More from Models
- Tencent Hy4 flash and InternLM Sage-S2.1-Flash both released, tool-calling tests requested — MajesticPuzzler · 2026-11-16
- User Shares Coral Reef Creation Labeled 'Qwen 4 Max (xhigh)', an Unannounced Model Name — intellectronica · 2026-11-16
- Stealth Model 'silicon-2' Surfaces in Devin, Suspected to Be Anthropic's Next Model — kimmonismus · 2026-11-16
- Google hides Gemini model label in AI Mode, rolls Gemini 4 Carbon to Pro subscribers — gaganghotra_ · 2026-11-16
- Open-weight Karpo-Decision-31B tops Decision Index at 73.9, one forward pass per answer — CodeByPoonam · 2026-11-16
- AI daily: DeepSeek rate-limits chats, Qwen haggling spurs shop warnings, Doubao workspace launch — 快鲤鱼 · 2026-11-16