Pipeline derives billions of high-quality tokens from historical newspapers with small models
institutional · hf · 2026-09-03
A modular pipeline uses small interpretable models to extract structured text and metadata from historical newspaper scans, yielding a large open dataset with billions of high-quality tokens.
More from Research
- HCI papers increasingly use LLM judges while obfuscating it, researcher warns — IanArawjo · 2026-09-03
- Why VRChat Particle Pools Still Work: Gravity Naturally Converges States — Michael_Moroz_ · 2026-09-03
- Radix Sort Hit 5B Key-Value Pairs per Second With Zero Compute Shaders — Michael_Moroz_ · 2026-09-03
- Dev Ports True SPH Fluid Simulation to VRChat Udon, May Release on Booth — Michael_Moroz_ · 2026-09-03
- PRO-Step: Step-Level Process Reward Optimization Boosts Multi-Hop RAG (EMNLP 2026) — _reachsumit · 2026-09-03
- Meta's CORAL: An LLM-Native Harness That Continuously Optimizes Production Recommenders — _reachsumit · 2026-09-03