RareBench results: Gemini 3.7 Flash leaps ahead, DeepSeek Pro shows no gain
danielmckinn0n · x · 2026-08-18
Gamowlabs published a RareBench (rare-disease genomics benchmark) blog post, with paper and data coming soon. Key findings:
- Gemini 3.7 Flash is a huge leap over Flash 3.6. If Google DeepMind can flip the remaining yellow categories to green, it would be near SOTA while fast and reasonably cheap. The author adds he loves the model for interactive genomics research use-cases — smart enough in the domain that its speed really accelerates online hypothesis generation.
- DeepSeek Pro results confirmed: despite overwhelming sentiment that the model was a great overall leap forward, it shows no improvement over Flash on RareBench.
More from Models
- ChatGPT outage logs users out across all mobile apps as OpenAI investigates — JeremyNguyenPhD · 2026-10-16
- Meta open-sources Muse Spark Open agent model with day-0 TPU support in SGLang — BanghuaZ · 2026-10-16
- Saying "load-bearing" in your prompt makes Opus 5.5 stop holding back — zacharynado · 2026-10-16
- Americans get their Claude accounts banned while on business trips in China — dotey · 2026-10-16
- I priced every Grok Bot call: $20 to $200 plan in 5 days, long jobs eat 52% — jonathanmalkin · 2026-10-16
- NVIDIA releases Nemotron-3.5-Embed-1B, a multimodal embedding model covering 34 languages — jacek2023 · 2026-10-16