BigMac Open Sourced: Up to 1.9x Speedup for Multimodal LLM Training

AdinaYakup · x · 2026-08-20

Dots Studio open-sourced BigMac, a pipeline scheduling system purpose-built for VLM training. BigMac co-schedules heterogeneous vision and language workloads through a dependency-safe nested pipeline, preserving LLM efficiency while reducing pipeline bubbles and activation memory. It delivers 1.08–1.9× training speedups over existing baselines.

Original post →

More from Infra

Infra channel →