AlphaGenome Variant Performance Looks 'Middle of the Pack' Once Distillation Is Stripped Out, Researcher Finds
jeffvierstra · x · 2026-09-19
Researcher jeffvierstra shared hands-on benchmarks of genome models in a discussion with Anshul Kundaje and Steven Salzberg: chromBPNet works best on cell-selectivity peaks, while AlphaGenome is middle of the pack on open-chromatin variant tasks once model distillation is removed. Signed Pearson correlations are nearly identical across models, suggesting distillation mostly adjusts noise; pre-distilled AlphaGenome checkpoints aren't public so it can't be fully verified.
Related event: Benchmarks Question Distilled AlphaGenome's Performance(3 posts)→
More from Research
- PixelBench: testing multimodal models pixel-by-pixel instead of with QA — bdsqlsz · 2026-11-04
- François Chollet: modeling brain wiring as an engineering problem constrained by genome size and time — CatAstro_Piyush · 2026-11-04
- OffsecCyber dataset combines HackerOne reports and CVEs to train pentesting LLMs — AccBalanced · 2026-11-04
- Monofact rate in training data governs LLM scientific discovery, preprint finds — CatAstro_Piyush · 2026-11-04
- qwenTPU compiles a TPU into Qwen3.5 weights, achieving exact integer matmul — CatAstro_Piyush · 2026-11-04
- Jev model improves ICL demonstration retrieval via distillation into a lightweight MLP — kalyan_kpl · 2026-11-04