NVIDIA fine-tunes Nemotron ASR for Saudi dialects, cutting WER from 55% to 30%
NVIDIAAI · x · 2026-10-03
NVIDIA published a tutorial on adapting its Nemotron 3.5 ASR (40 language-locales) to Saudi Najdi and Hijazi dialects.
- Using the NeMo framework with minimal curation, weighted replay mixing with FLEURS, duration bucketing, and partial encoder unfreezing, 133.7 hours of dialect data cut WER on the target test split from 55.05% to 29.96%, while English WER slightly improved (11.04%→10.42%) and other Arabic dialects held up.
- Unfreezing all 24 encoder layers gave the best accuracy (230.4M trainable params); freezing layers trades accuracy for compute when resources are limited.
- Inference-only changes—13 lookahead frames plus beam-8 MALSD decoding—lowered WER another 2.71 absolute points for 800ms extra latency, suited to batch transcription.
- The workflow extends to speaker-attributed transcription for up to 8 speakers via Nemotron 3 Diarization, with a reproducible notebook provided.
More from Models
- SGLang ships Day-0 serving support for new model DaisyRose-27B — ying11231 · 2026-11-19
- Tibo's spicy take on why Astra 6.2 is getting such bad reviews — eigenrobot · 2026-11-19
- User builds interactive 3D molecular viewer macOS app with GPT-6.2 Astra — DeryaTR_ · 2026-11-19
- Caliper Harness: open-source coding harness disciplines small local models with plans, checks, reviews — Saraozte01 · 2026-11-19
- DaisyRose-27B's in-house sandbox: ~80% cheaper than cloud providers, 99.95% success rate — BanghuaZ · 2026-11-19
- Tencent's 220B Hy4-flash quantized to 49 GB weights, runnable on 64 GB VRAM — gladkos · 2026-11-19