Sakana AI and Nvidia Unveil TwELL Sparse LLM Solution
SakanaAILabs · x · 2026-07-04
Sakana AI and Nvidia have introduced the TwELL sparse packing format. It adapts to optimized chunked GPU tasks and features custom CUDA kernels to accelerate LLM training and inference. Training and benchmarking on billion-parameter sparse models show a speedup of over 20%, alongside even greater reductions in peak memory and power consumption. The paper will be presented at ICML 2026.
More from Infra
- Anthropic S-1: training infra edge cut per-task cost 40% and doubled revenue growth — BenBajarin · 2026-10-26
- Rewriting scaling law study: optimal synthetic data share rises from 10% to 32% with compute — heghbalz · 2026-10-26
- US states halt new data centers as 72% of Americans oppose local builds — YvesMulkers · 2026-10-26
- $5M Seed Round Can't Afford One DeepSeek Training Run: GPU-less AI Startup's Three Paths — FinanceYF5 · 2026-10-26
- HBM demand shifts: low-stack inference plans shelved, Rubin to go 12-high only — BenBajarin · 2026-10-26
- CircuitHub unveils The Grid, a factory-scale robot making PCBs in the US twice as fast as Shenzhen — garrytan · 2026-10-26