Design note: an architecture for experimenting with dynamic curricula in data loading
josh_wills · x · 2026-10-07
Point #3 of Josh Wills' data loading library thread: an architecture for experimenting with dynamic curricula. Much cool research in this area never reaches the broader community because there's no well-supported, well-documented data loading library to handle the boring parts — this library aims to be that home so researchers can focus on research.
Related event: Josh Wills Open-Sources New Data Loading Library at Datology(5 posts)→
More from Infra
- TypeSafeAI served a trillion tokens on Modal within four days of Jev launch — josh_wills · 2026-10-08
- OpenAI Compute 'Speedrun': Then-vs-Now Comparison Shows Explosive Scale-Up — ns123abc · 2026-10-08
- The endgame AI: a tiny local model across your phone, laptop and glasses that knows you best — VraserX · 2026-10-08
- Josh Wills defines the data loader, jokes fly as DatologyAI ships new 'Zephon' loader — josh_wills · 2026-10-08
- Cross-model retrieval: pplx-embed-v2's 0.6B querying a 9B index beats a 0.6B index — antoine_chaffin · 2026-10-08
- ServeTheHome's 10K-word DGX Station teardown: 800Gbps to Blackwell Ultra but only 229Gbps to Grace — AccBalanced · 2026-10-08