Cerberus: Open SSM-Based Genomic Models Beat Transformers on QTL Prediction

anshulkundaje · x · 2026-10-10

A team released a preprint exploring state space models (SSMs) for long-sequence genomic prediction, alongside Cerberus, an open set of PyTorch models built on this work. Swapping transformers for SSMs yields better QTL predictions and faster sequence mixing. State-space duality also makes the models interpretable: shallow layers stay local while deeper layers reach farther and anchor on TSSs and CTCF sites. Preprint and code are open.

Related event: Cerberus: open-source SSM models for long-sequence genomic prediction(2 posts)→

Original post →

More from Research

Research channel →