Help: Converting Qwen3.8 27B to ONNX for NPU Usage
xXDennisXx3000 · reddit · 2026-08-17
A user seeks help converting Qwen 3.8 27B from safetensors (bf16) to ONNX format. The goal is to enable full utilization of hybrid NPU + GPU setups on devices like Strix Halo.
The user reports failed attempts over 3-4 days on Linux Ubuntu and requests community assistance to complete the conversion and share the model.
More from Infra
- 14 open-source LLM observability tools to know in 2026, from Langfuse to Laminar — TheTuringPost · 2026-10-16
- Local AI is a routing problem, not a privacy feature: where each task should run — bigdata · 2026-10-16
- Moving agent work from GPUs to CPUs for durable, predictable actions — cramforce · 2026-10-16
- First TPUv7 agentic benchmark on vLLM claims 1.42x perf-per-dollar over GB300 NVL72 — vllm_project · 2026-10-16
- Phison CEO calls CXMT memory scare a 'ghost story', warns of materials shortage — BenBajarin · 2026-10-16
- Ben Bajarin: The Future of Compute Is Fungible as Hyperscalers Design for Workload Flexibility — BenBajarin · 2026-10-16