SGL Releases Qwen3.8-27B NVFP4 Checkpoint with BF16 LM Head for Higher Accuracy
EAccelerate_42 · x · 2026-08-25
SGL project released a new NVFP4 checkpoint for Qwen3.8-27B featuring a BF16 lmhead. Testing indicates that pairing an FP8 KV cache with a BF16 lmhead yields significant accuracy improvements, catering to users with stricter precision requirements. The cookbook has been updated to reflect this new option.
More from Models
- Redditor finds MiniMax H3 performs far better with Mandarin prompts than English — apoke890 · 2026-08-25
- Suspected Gemini 3.8 Flash leak surfaces on Reddit — Last_Conclusion_8984 · 2026-08-25
- Train Only Projector to Add New Modalities Without Regressing LLM Capabilities — rohanpaul_ai · 2026-08-25
- User swaps one word, gets very different AI results — claims sexism — RecordingThis6802 · 2026-08-25
- Fal releases post-trained H3 model co-optimized with custom inference stack — isidentical · 2026-08-25
- Real-time voice AI hears emotion but ignores it: 119 of 120 runs followed the script — Once_ina_Lifetime · 2026-08-25