AlphaGenome Variant Performance Looks 'Middle of the Pack' Once Distillation Is Stripped Out, Researcher Finds
jeffvierstra · x · 2026-09-19
Researcher jeffvierstra shared hands-on benchmarks of genome models in a discussion with Anshul Kundaje and Steven Salzberg: chromBPNet works best on cell-selectivity peaks, while AlphaGenome is middle of the pack on open-chromatin variant tasks once model distillation is removed. Signed Pearson correlations are nearly identical across models, suggesting distillation mostly adjusts noise; pre-distilled AlphaGenome checkpoints aren't public so it can't be fully verified.
Related event: Benchmarks Question Distilled AlphaGenome's Performance(3 posts)→
More from Research
- Skeptical deep dive confirms Humanity's Last Exam errors; official o3-mini grader marked right answers wrong every time — paul_cal · 2026-09-20
- Sarah Hooker shares a Colab notebook that 'invents' a dataset in a few lines of code — sarahookr · 2026-09-20
- A 0.62-AUC classifier helped discover 6 new altermagnets: AI's job is making one loop step cheap — bravo_abad · 2026-09-20
- "Self-Evolving Search Index" paper sparks SEO buzz: indexes that auto-adapt to abuse — gaganghotra_ · 2026-09-20
- Researcher's New Routine: Most Time Now Spent Reading Papers Written by His Own Models — generativist · 2026-09-20
- FrontierSWE v2 opens 24.1-point gap: Claude Fable 5.1 scores 56.29% vs GPT-5.6's 32.2% — geoffwolfe · 2026-09-20