Genomics dev ran minibwa and MACS3 25k times to vet AI speedup PRs against a 2TB test suite

jmschreiber91 · x · 2026-10-30

Developer jmschreiber91 explains how AI-generated performance PRs for genomics tools get vetted: minibwa and MACS3 were each run over 25,000 times to confirm identical outputs on good data and similar failures on malformed data, so the optimization doesn't silently remove a guardrail.

The bulk of the effort went into the Genomics Test Suite — over 2TB of genomic data (real and malformed versions, varied qualities and assays) that serves as the regression baseline for these tools.

Related event: auto-optimize speeds up 11 bioinformatics tools; giant PRs spark review debate(22 posts)→

Original post →

More from coding & agent

coding & agent channel →