Pruned NVIDIA's 30B speech LLM from 67.5GB to 10GB with zero retraining, 5.16% WER
Illustrious_Row_9971 · reddit · 2026-10-29
A Reddit user pruned NVIDIA's newly released 30B speech transcription LLM from 67.5GB down to 10GB without any retraining, achieving a 5.16% WER versus the teacher model's 4.12%. The compressed model is available on Hugging Face (akhaliq/nemotron-3.5-transcribe-mini-64e), demonstrating that aggressive pruning can shrink speech LLMs with minimal accuracy loss.
More from Models
- Claude Duet Appears to Be Rolling Out to Many More Users — imjustnewatai · 2026-10-29
- Qwen3.5-4B hits ~11.4 tok/s CPU-only on a Ryzen 5 laptop with llama.cpp tuning — solyarisoftware · 2026-10-29
- A video 'made by Opus 5.5' surfaces as Anthropic leak chatter grows — repligate · 2026-10-29
- US models lead China's on use-case post-training and even frontier benchmarks — teortaxesTex · 2026-10-29
- Terra tops Artificial Analysis over Kimi and Fable, sparking benchmark trust debate — teortaxesTex · 2026-10-29
- Gemini refuses to answer questions about public domain books like Macbeth — stordyr · 2026-10-29