Critic says readers trusted the plots without reading the experiment section
suchenzang · x · 2026-08-04
The post criticizes people who repeated the paper’s claims without actually reading the experiment section.
The author points out that key details are still unclear, including:
- how many parameters were used
- whether results for k=1/2/3 were shown for all models
- what models were used for the other modalities mentioned in the takeaway
The core complaint is that readers accepted the plots as truth without checking the experimental setup.
More from Research
- A 36-page Fable CoT summary tackles a biology problem — Sauers_ · 2026-08-04
- Lanyon benchmark says frontier models fail Euler solvers with oscillations and wrong accuracy — CatAstro_Piyush · 2026-08-04
- A 2016 3D reconstruction paper reappears in a debate over top-K losses — YouJiacheng · 2026-08-04
- Alibaba’s UEmbed unifies sparse and dense multimodal retrieval in one model — Alibaba-NLP · 2026-08-04
- WorldExam benchmarks whether video models generate worlds that actually react — Yuxue Yang · 2026-08-04
- SKT uses verified synthetic trajectories to train agents to use skills better — Shanghai-AI-Laboratory · 2026-08-04