MTP dropped in new model's tech report: fp8 lookup tables and prime table sizes noted

stochasticchasm · x · 2026-09-11

Reading a new model's tech report, the author notes MTP was removed—likely because the uplift wasn't worth it. The engram section reveals unusual details: table sizes chosen as distinct primes, 4-grams not seen in comparable models, and fp8 lookup tables suggesting an inference-side design.

Related event: New Model's KV Cache QAT and Dropped MTP Spark Debate(4 posts)→

Original post →

More from Models

Models channel →