Microsoft's MLVC tackles cross-platform bottleneck in neural video codecs

tanelai · reddit · 2026-07-31

While neural networks have replaced many traditional algorithms, video codecs are still dominated by hand-engineered systems like h.264/h.265. The main bottleneck is cross-platform compatibility: numerical precision differences across hardware NPUs cause entropy model decoding to fail. Current INT8 quantization or fixed-point math cannot guarantee bit-exact results.

Microsoft's proposed MLVC (Multi-platform Learned Video Codec) circumvents this by explicitly transmitting the entropy model's scale parameters via the hyperprior, removing the need for bit-exact NPU operations. It achieves 100 FPS for 360p/540p video encoding/decoding on consumer NPUs, making real-world deployment feasible.

Original post →

More from Research

Research channel →