NVIDIA's BioNeMo Inference Runtime hits public beta, boosting Boltz-2 folding throughput 2.9x
AllThingsApx · x · 2026-09-10
NVIDIA released BioNeMo Inference Runtime in public beta: an open, PyTorch-native library that accelerates biomolecular structure-prediction inference on NVIDIA GPUs.
Key points:
- End-to-end pipeline from input parsing, tokenization and feature generation through GPU inference to PDB/mmCIF output, plus direct PyTorch module integration.
- Optimization at three layers: kernel selection, CUDA Graph capture for module optimization, and Ray-powered GPU replicas for pipeline scaling.
- In a matched benchmark of 1,000 human dimer targets on 8xH100 GPUs, accelerated Boltz-2 delivered 58.5K successfully folded residues per GPU-hour vs 20.2K for a torch-compiled open-source implementation — a 2.90x residue-normalized throughput gain.
- Estimated energy to fold one million comparable targets drops from 35 MWh to 11 MWh.
- Supports Boltz-2, OpenFold2, and Protenix v2, with partners including apheris, SandboxAQ, and Xaira.
More from Infra
- Two CVSS 9.9 Wasmtime flaws allow sandbox escape, one ARM64-only since 2020 — basedjensen · 2026-10-27
- AI Infra Meme: While Countries Need TW-Scale Power for Datacenters, People Argue About Lightbulbs — mgostIH · 2026-10-27
- Legora runs 2,000 parallel agent evals on Modal Sandboxes for legal AI — blelbach · 2026-10-27
- Cloud release velocity scores: AWS 95, Azure 90, Google Cloud 82 — DavidLinthicum · 2026-10-27
- Selling a 5090 to scale local inference: one business weighs 5 hardware paths — Anarchaotic · 2026-10-27
- AWS tutorial: fleet-wide edge CV model lifecycle with SageMaker SDK v3, ~$0.07 per run — AWS ML Blog · 2026-10-27