YouJiacheng 详算 K3 与 V4.1F 的 KV cache:每 token 14400 字节对 890 字节

YouJiacheng · x · 2026-10-26

Responding to z4y5f3's perf modeling claims, YouJiacheng provides the concrete numbers: K3 has 24 MLA layers, each using 600 bytes/token with FP8 KV, totaling 14400 bytes/token, versus V4.1F's 890 bytes/token — revising the claimed 40x KV cache gap down to 16x. Read together with the parent post in this dispute over serving costs.

所属事件:Kimi K3 推理成本之争:解码算力悬殊,贵 DeepSeek V4.1F 约 20 倍(6 条相关)→

原文链接 →

「Infra」频道最新

更多「Infra」频道 AI 资讯 →