vLLM and MiniMax Release H3: Open-Weight Native Audio-Video Generation
vllm_project · x · 2026-08-03
The vLLM project collaborated with the MiniMax team to release the deployment recipe for MiniMax-H3, an open-weight multimodal generation model.
- Core Capabilities: Reads a mixed multimodal context (text, images, video, audio) to generate coherent audio-visual output end-to-end, rather than dubbing audio afterwards.
- Architecture: A CFG-distilled joint video/audio diffusion transformer (DiT) served via vLLM-Omni's OpenAI-compatible API. Returns a single MP4 containing H.264 video and native stereo audio.
- Performance: Generates 8.7s of 1248×768 video with synchronized stereo audio in 87 seconds on 4×B300 GPUs.
- Deployment: Ships as two independently served partitions (FL2VA for text/first-last frame, Ref2VA for omni references), requiring a server restart to switch tasks.
Related event: MiniMax open-sources 33B multimodal video model H3(35 posts)→
More from Infra
- China's AI boom drives up to 660% profit surges for domestic chip firms; GPU maker MetaX turns profitable — pstAsiatech · 2026-10-16
- Qdrant tests Perplexity's visual PDF embeddings: 21x smaller vectors, 99.9% after rescoring — jrxna · 2026-10-16
- When Does an Agent Actually Need an API Gateway? Reddit Weighs Direct Calls vs. Unified Endpoints — TurbulentStiffness · 2026-10-16
- Taiwan to build $4B AI manufacturing complex in Texas to back Nvidia and TSMC — Polymarket · 2026-10-16
- When the KV Cache Is Slower Than the GPU: Remote KV Tiers Backfire in Production — MultiverseComputingCAI · 2026-10-16
- GitHub rewrote the 800k-line Copilot runtime in Rust using AI agents, cutting CPU and memory by over 90% — bibryam · 2026-10-16