NVIDIA launches BioNeMo Inference Runtime: 2.9x throughput for structure prediction, 1.6-3x in production
AllThingsApx · x · 2026-09-11
NVIDIA Health released BioNeMo Inference Runtime (BioIR), accelerating biomolecular structure-prediction models on NVIDIA GPUs while preserving the PyTorch workflow.
Technical highlights:
- End-to-end processor covering parsing, tokenization, feature generation, GPU inference, and PDB/mmCIF output, plus direct PyTorch module integration
- Three optimization layers: kernel selection, module optimization with CUDA Graph capture, and pipeline scaling via Ray replicas
- Benchmark: on 8xH100 across 1,000 human dimer targets, BioIR-accelerated Boltz-2 delivered 58.5K folded residues per GPU-hour vs 20.2K for a torch-compiled open implementation — a 2.90x improvement
- Energy: folding one million comparable targets costs 11 MWh vs 35 MWh for the public implementation
Production feedback: Proxima reports 1.6–1.9x throughput gains on H100 (up to 3x on short inputs) across distillation and refolding pipelines, with a coding agent wiring it into Neo in one shot via the BioNeMo agent skill.
More from Infra
- Grid queues make power architecture an AI-factory decision; Exowatt and Redwood offer fixes — ingliguori · 2026-10-27
- Two CVSS 9.9 Wasmtime flaws allow sandbox escape, one ARM64-only since 2020 — basedjensen · 2026-10-27
- AI Infra Meme: While Countries Need TW-Scale Power for Datacenters, People Argue About Lightbulbs — mgostIH · 2026-10-27
- NVIDIA reportedly stops taking RTX 5090 orders from board partners, even backorders — chemist_slime · 2026-10-27
- Legora runs 2,000 parallel agent evals on Modal Sandboxes for legal AI — blelbach · 2026-10-27
- Cloud release velocity scores: AWS 95, Azure 90, Google Cloud 82 — DavidLinthicum · 2026-10-27