Apple Proposes Token-Level Length Value Model to Optimize Inference Cost
Apple ML Research · rss · 2026-07-20
Apple's machine learning team introduced the Length Value Model (LenVM), a novel framework designed to address how generation length impacts both inference cost and reasoning performance in autoregressive models.
While existing approaches primarily operate at a coarse-grained sequence level, LenVM introduces fine-grained, token-level length modeling. By formulating length modeling as a value estimation problem, the framework predicts the remaining generation length at each decoding step and assigns a constant negative reward to each generated token, enabling more scalable and precise pretraining.
More from Research
- HarmonicMath says Lean autonomously solved eight previously studied open problems — MarioKrenn6240 · 2026-07-21
- SeeSE3 finds 3D structure emerging in frozen vision features and camera-pose alignment — ducha_aiki · 2026-07-21
- A parody prompt asks for a planetary crystal factory inventory and parity report — Promptmethus · 2026-07-21
- PRA hits new image-generation SOTA with 511M parameters and FID 1.94 — jiqizhixin · 2026-07-21
- SUFLECA shows NOC-based correspondence can improve CAD-to-image alignment — ducha_aiki · 2026-07-21
- OpenAI-style autonomous researchers could become real scientific collaborators — Promptmethus · 2026-07-21