LlamaIndex stacks 17 optimizations for near-10x OCRia-1 speedup on one B200

LlamaIndex boosted its 4B document parsing model OCRia-1 from 285 to 2800 tok/s on a single B200, roughly 10x faster, by stacking 17 small optimizations to better utilize the GPU.

2026-11-04 ~ 2026-11-04 · 2 related posts

• LlamaIndex stacks 17 small optimizations for ~10x faster OCRia-1 token generation on a single B200 — llama_index · 2026-11-04
• LlamaIndex speeds up doc-parsing model OCRia-1 10x to 2800 tok/s on one B200 — llama_index · 2026-11-04