Rebuild NVIDIA's speaker-captions demo with one transformers serve command
yb2698 · x · 2026-10-30
The Hugging Face team rebuilt NVIDIA's viral speaker-captions demo with transformers serve. Nemotron 3.5 Transcribe is the top open-weight model on the Open ASR Leaderboard: a promptable 30B MoE with 4B active parameters, covering 40 languages and up to 1 hour of audio, with speaker attribution, translation, and audio understanding.
Everything works through a single call to the /v1/audio/transcriptions endpoint. Serving it locally takes one command:
transformers serve nvidia/NVIDIA-Nemotron-3.5-Transcribe-30B-A4B
More from Infra
- Google's Ed Chi asks: will future phones be thin clients or run more on-device intelligence? — edchi · 2026-10-30
- UkisAI cuts thinking tokens 61.4% on GLM-5.3-Flash with under 0.5% accuracy loss — Secure_Recording_472 · 2026-10-30
- tiny-llm: an open-source course where you build a vLLM-style inference engine for Qwen3 on a Mac — techNmak · 2026-10-30
- WanGP one-click launcher hits Pinokio: AI video generation on 6GB+ VRAM GPUs — cocktailpeanut · 2026-10-30
- DeepSpeed fixes ZeRO-2 fp32 precision bug, users urged to upgrade to 0.19.8+ — StasBekman · 2026-10-30
- AMD ships ROCm HRX Loom v0.1 targeting its CPUs, GPUs and NPUs — Fcking_Chuck · 2026-10-30