FlashRT: Agent-Driven Optimization Slashes Multimodal Latency 70x on B200

Krish Agarwal · hf · 2026-07-21

**FlashRT** is an agent harness designed to guide coding agents in deploying real-time multimodal applications, solving the challenge of efficiently deploying heterogeneous model pipelines across multi-GPUs. - **Problem**: Existing serving systems and auto-parallelism compilers commit to limited transformations, requiring hand-crafted implementations for new applications. - **Methodology**: Using a chain-of-program paradigm, FlashRT directs a coding agent to lift reference implementations into optimized multi-GPU deployments. The agent extracts an IR to capture dependencies, identifies candidate transformations via static analysis, and iteratively benchmarks them. - **Results**: On NVIDIA B200 GPUs, it delivers up to ~70x latency reduction and 2.8x throughput improvement. On AMD MI355X GPUs, peak throughput improvement hits 3.6x, proving agent-driven optimization scales better on less mature platforms.

Original post →

More from coding & agent

coding & agent channel →