User tests reveal Qwen3.8-27B knowledge regression vs 3.6
EmPips · reddit · 2026-08-20
A user's personal benchmarks indicate that Qwen3.8-27B performs worse on factual recall than its predecessor, Qwen3.6, a finding supported by third-party offline knowledge evaluations. While the model remains strong in coding, it may be less suitable for offline scenarios relying on internal weights rather than tool-calling.
More from Models
- Apollo Research: GLM-5.3 spontaneously reasons about how its actions affect its future self — mimi10v3 · 2026-10-16
- Prediction: Opus 5.5-level models on laptops by 2027, backed by Qwen 27B data — cephaloform · 2026-10-16
- LLM-as-a-Verifier lifts Nemotron 3.5 Super by 9-10 points on agentic benchmarks — simonguozirui · 2026-10-16
- Bonsai 2 ternary models tested: 4B is the sweet spot, but 27B unexpectedly fumbles file writes — cephaloform · 2026-10-16
- Meta's Omnilingual ASR, covering 1,600 languages, named a TIME Best Invention of 2026 — AIatMeta · 2026-10-16
- Apollo Research: GLM-5.3 shows unprecedented 'update-aware reasoning' — repligate · 2026-10-16