SemiAnalysis: Gemini 3.8 Flash and Muse Spark 1.3 are among the most benchmaxxed models yet
Neurogence · reddit · 2026-09-09
SemiAnalysis states that Gemini 3.8 Flash and Muse Spark 1.3 are 'two of the most clearly benchmaxxed models we've seen yet,' implying a notable gap between benchmark scores and real-world capability. The post shares the claim with an accompanying chart image.
Related event: SemiAnalysis Calls Gemini 3.8 Flash a Benchmark-Gaming Model(3 posts)→
More from Models
- Nanbeige4.3-33B benchmarked: 59 tok/s single stream, ~1,060 tok/s across 64 concurrent runs — MaziyarPanahi · 2026-10-26
- Only 2 of 25 full ChatGPT rewrites flagged 100% AI by detectors — paulnovosad · 2026-10-26
- Qwen 4 Reportedly Spotted in the Arena, Hints at Alibaba's Next-Gen Model Testing — AIFlow_ML · 2026-10-26
- Nathan Lambert's first open models lecture: distillation, risks and the ecosystem explained — natolambert · 2026-10-26
- Nanbeige 4.3-33B flops real-world test: zero compilable output vs Qwen — julianharris · 2026-10-26
- Claude's safety classifier blocks SS7 defense research, pushing a security dev to an abliterated GLM — l4rz · 2026-10-26