Unsloth AI to launch new kernels, predicting 300 tok/s on C8
QuixiAI · x · 2026-08-20
Developer QuixiAI plans to build optimized kernels for Unsloth AI, predicting speeds of 60 tok/s on C1 compute and 300 tok/s on C8 compute after tuning.
Related event: Modded 48GB RTX 3090 Runs 27B Model Locally at High Speeds(4 posts)→
More from Infra
- UK AI Chip Startup CallosumAI Raises $100M Seed — HZoete · 2026-08-20
- UK Chip Startups Raise Over $900M in Two Weeks — HZoete · 2026-08-20
- Loudoun County: Most data centers and highest median income in US — kevinnbass · 2026-08-20
- Rust Compiler Contributor Sets Goal: Make rustc 10x Faster — mitsuhiko · 2026-08-20
- Paper: LLMs Beat Embeddings Slightly but Cost 1,431x More — Muennighoff · 2026-08-20
- Why hasn't AI pricing increased to its 'true cost' yet? — MacIntoic · 2026-08-20