Gemma-4-26B-a4B reportedly beats Qwen3.6 and Qwen3.5 MoE fine-tunes
JLeonsarmiento · reddit · 2026-07-22
A Reddit user says an updated Gemma-4 chat-template setup gives Gemma-4-26B-a4B the edge over Qwen3.6-MoE and Qwen3.5-MoE fine-tunes in instruct mode and reasoning efficiency.
They call the result unexpected, say it is a win for Google and the local-LLM community, and add that Qwen3.6 still does better in Hermes. The user argues that a Gemma-4.1 fine-tune aimed at agentic tasks would be especially strong.
More from Models
- DeepSWE Eval: Kimi K3 Matches Claude Fable 5 at 35% of the Cost — togethercompute · 2026-07-22
- Gemini 3.5 Flash Outperforms GPT-5.6 in Light Coding Tasks — Shick_hydro · 2026-07-22
- NVIDIA says Nemotron 3 Ultra scored 30/42 on the 2026 IMO problems — NVIDIAAI · 2026-07-22
- OpenAI is reportedly briefing U.S. lawmakers on its next model family — kimmonismus · 2026-07-22
- Muse Spark 1.1 lands at 1495 on Text Arena with standout agentic-coding price performance — ycombinator · 2026-07-22
- Advanced AI Models Are Becoming Impossible to Plug and Play — emollick · 2026-07-22