Kimi V4 is headed for native multimodality, but Moonshot says compute is the limit
teortaxesTex · x · 2026-07-23
Moonshot’s Kimi V4 is said to be heading toward native multimodality, and the image-backed quote says V4 is already as large as the team can train right now.
Key points from the post and image:
- Kimi V4 and its follow-up versions are expected to support native multimodality.
- The model is described as being trained at the largest size the team can currently afford.
- The implied bottleneck is compute, not lack of willingness to scale.
- The post also suggests that a successful funding round could let Moonshot train larger models and push further on scaling.
The broader message: Kimi is signaling both a multimodal roadmap and a very explicit compute constraint.
More from Infra
- CoreWeave 5-year CDS spikes to ~1,100bps as market fears AI bubble starts as credit event — kimmonismus · 2026-10-26
- NVIDIA Plans ~$2,000 Per GPU Per Year Software Fee for Running AI Agents — LinusEkenstam · 2026-10-26
- 12 DevOps concepts to learn in order, from Linux to SRE — _jaydeepkarale · 2026-10-26
- Killed our Vector DB for SQLite BM25 and wrote a 3.6ns Rust sentinel: lessons from multi-agent loops — OpenComplaint524 · 2026-10-26
- Gemma 4 26B-A4B runs offline on a 16 GB Mac: 33/40 on TypeScript tasks at 31 tok/s — Mission-Sir-1614 · 2026-10-26
- How thousands of GPUs train one AI: a breakdown of 5D parallelism — jbhuang0604 · 2026-10-26