ViT shrinks 54.5x to 6MB for on-device crop disease detection
jm_alexia · x · 2026-09-07
An arXiv paper proposes a unified ViT compression framework combining Hessian-balanced adaptive block pruning (H-BAC), quantization, and attention-based knowledge distillation for on-device deployment in resource-constrained agriculture.
- Model shrinks from 327.42MB to 6.01MB (54.5x) while retaining 95.13% of FP32 accuracy on a cross-village chilli disease test
- A same-size INT8 student trained directly reaches 94.87%
- Commenter notes: deployment win is clear, but the distillation gain remains unshown
More from Research
- Thousands of AI drug discovery firms, only a handful of end-to-end automated labs — robleclerc · 2026-09-08
- Insilico's AI drug Rentosertib shows 3-4 year biological age reversal in 12 weeks — NinaDSchick · 2026-09-08
- Speridlabs releases ENEAS, a text-promptable tracking method claiming gains over SAM3 — joecole · 2026-09-08
- UCL's Large Discovery Models hit SOTA, 2.4x LLM reflection on experiment search — jiqizhixin · 2026-09-08
- First IAB workshop on agent behavior draws 260 submissions, seeks reviewers — mdredze · 2026-09-08
- Dr. Claw: Open-Source AI Scientist Workspace Wrapping Coding Agents for Auditable Research — Dingjie Song · 2026-09-08