Scholars argue research should first stress-test existing LLMs
Michael Black argues that research projects should first push existing LLMs to their limits and analyze failures before proposing new methods. He also criticizes review culture's obsession with technical novelty and suggests papers add a section evaluating current LLMs on the task.
2026-09-18 ~ 2026-09-18 · 2 related posts
- Episode 1: Michael Black Questions the Role of Academic CV Research in the Era of Large Models(2026-09-09, 7 posts)
- Episode 2: Post-GPT-6 Gloom at ECCV: CV Papers Already Two Years Behind(2026-09-17, 6 posts)
- Episode 3: VIGA thread: exhaust LLMs first; paper cycles lag behind models(2026-09-18, 2 posts)
- Episode 4: Scholars argue research should first stress-test existing LLMs(2026-09-18, 2 posts)
- Scholar urges academics to benchmark frontier models first before proposing new methods — FinanceYF5 · 2026-09-18
- Papers should add a section benchmarking frontier models, argues VIGA thread on broken peer review — FinanceYF5 · 2026-09-18