TensorFold 1.2.10: 57% faster Qwen3.8-27B decode on GB10, plus new Metal models

AIFlow_ML · x · 2026-11-19

TensorFold 1.2.10 ships with 57% faster decoding for Qwen3.8-27B on GB10 (8 streams, shared 32K prefix) and 5–7% faster cold prompts for DeepSeek-V4.1 on M5 Ultra. The release adds background responses, tensorfold launch/rm commands, and Qwen3-Embedding plus Unlimited-OCR-2 on Metal. The engine supports Apple Silicon, CUDA and AMD HIP/Vulkan with published real-hardware benchmarks (e.g. Nemotron 3.5 Lightning at 874 tok/s on RTX PRO 6000 Blackwell).

Original post →

More from Infra

Infra channel →