Sampling test: pplx-decider-v1.1 judges pretraining data quality out-of-the-box vs Fineweb-edu classifier
bo_wangbo · x · 2026-10-08
Many teams rely on embedding-model-based classifiers like Fineweb-edu-classifier (a 6-class rubric) to filter high-quality pretraining data. The author sampled 1k Fineweb-2 pages and compared Jev/pplx-decider-v1.1 against Fineweb-edu-classifier using Astra annotations as ground truth, concluding that decider works out-of-the-box as a data quality judge without dedicated classifier training.
More from Research
- Book anniversary: Data Mining, Practical Machine Learning Tools and Techniques — FrnkNlsn · 2026-10-08
- Bittensor's SN107 Lets Miners Earn by Running AI Agents to Produce Genomic Data — markjeffrey · 2026-10-08
- CoLM 2026 Poster: Vibe-Voting LLMs and Why Users Distrust Benchmarks — boknilev · 2026-10-08
- Baseten's Base Labs has all 3 papers accepted at NeurIPS workshops — baseten · 2026-10-08
- Open-vocabulary text search fused into Google 3D Tiles across 27M voxels of San Francisco — bilawalsidhu · 2026-10-08
- SEAR research project to debut at COLM 2026, paper and code coming soon — WenhuChen · 2026-10-08