EgoTools: 100-hour egocentric tool-use dataset lifts an 8B model's accuracy by 10.9 points
liuziwei7 · x · 2026-10-04
NTU S-Lab, with ASTAR, KAIST and others, released EgoTools, probing whether AI models can reason about tools the way humans do—not just what a tool is, but what it can do and when to use it.
- Dataset: 100.37 hours of real-world first-person video across 7 everyday domains, from kitchens to research labs
- Benchmark: 1,000 diagnostic questions across four tracks, testing tool grounding, usage tracking, and choice inference
- Model: an 8B reference model improves overall accuracy from 50.0% to 60.9% (+10.9 pp) with the same backbone and 64 frames
- Paper, code, data (Hugging Face), and the EgoTools-8B model are all publicly available
Related event: EgoTools: 100-Hour Egocentric Dataset for Tool-Use Reasoning(4 posts)→
More from Research
- Aurora2-400M-A20M: a sparse MoE pretrained from scratch in 36 hours on one RTX Pro 6000 — Tall_Abrocoma_3533 · 2026-11-19
- Researcher calls METR/Anthropic '2x speedup' RSI analysis statistically dubious — jessi_cata · 2026-11-19
- Linear Probes Could Reveal Which Persona a Base Model Is Playing, Researchers Suggest — cephaloform · 2026-11-19
- ETH's Anymal robot completes 10km autonomous alpine hike with VLM-guided ROAM system — ChongZzZhang · 2026-11-19
- OpenVax codebase grows from 78K to 565K lines in 15 months — iskander · 2026-11-19
- François Fleuret: decoder transformer's elegance — no trade-off hyperparameters — francoisfleuret · 2026-11-19