Meta researcher's training trick: drop a batch proportion instead of per-sample to keep GPU efficiency
TimDarcet · x · 2026-09-09
Meta researcher TimDarcet shares a practical training trick: instead of dropping each sample with probability p, drop a proportion p of each batch. This keeps tensor shapes constant and preserves GPU efficiency. He says this is how it's done in Meta's open-source capi vision training library (see model.py), and notes that if everything stays on GPU it compiles through perfectly.
Related event: Meta researcher shares batch-ratio token dropping training trick(3 posts)→
More from Research
- kornia-rs: Rust Low-Level 3D Vision Library Outperforms OpenCV and NVIDIA VPI — edgarriba · 2026-09-09
- Researcher cites more blogposts and HF links than papers, blames academia — antoine_chaffin · 2026-09-09
- ECCV 2026 workshop paper improves FoundationPose by enforcing a coherent scene — ducha_aiki · 2026-09-09
- ECCV 2026 keynote preview: Christian Rupprecht on 'Are we learning to rediscover geometry?' — ducha_aiki · 2026-09-09
- Tired of AI doom? Look at what Colossal Labs is doing with de-extinction — retr0jirachi · 2026-09-09
- New side-channel attack reconstructs local LLM outputs from CPU cache traces — chaumian · 2026-09-09