OCR at 7.7 pages/s on one RTX: 14,483 pages for just $1.67 with LightOnOCR
vanstriendaniel · x · 2026-11-11
Using LightOnOCR-3-0.8B from LightOn on a single RTX PRO 6000 via Hugging Face Jobs with vLLM, the author OCR'd 14,483 pages of fossil fuel industry documents at 7.7 pages/s, costing $1.67 total ($0.12 per 1,000 pages). The recipe was tuned for Jobs and is reproducible with one command.
More from Infra
- xAI dumps JAX, rewrites full RL/inference stack in C/C++ as Grok 4.8 enters RL — ivan_bezdomny · 2026-11-11
- RidgeFill: training-free speculative prefill cuts TTFT up to 1.6x with near-baseline quality — Public_Umpire_1099 · 2026-11-11
- NVIDIA ships NCCL 2.32.6 with Vera Rubin tuning and new device APIs — simonguozirui · 2026-11-11
- FlashAttention co-creator Dan Fu on kernels, inference economics, and owning vs leasing GPUs — realDanFu · 2026-11-11
- Self-hosting agent sandboxes on AWS costs a quarter of Daytona's list price — KlausCodes · 2026-11-11
- The Jensen Huang Affair Is the Least Interesting Part: Tracing the $4.8B Nvidia-to-Megaspeed GPU Story — imdigitalashish · 2026-11-11