Researchers call out SOTA tables without ablations as flawed, ad-like paper marketing
Ajinkya_2107 · x · 2026-10-10
Researcher HildeKuehne urged anyone sharing papers on X to include their SOTA table and at least basic ablation results at the end of the thread — otherwise, she argues, the post should be labeled an advertisement. Replying, Ajinkya2107 adds that current SOTA comparisons rarely control for epochs, parameter counts, and other conditions, making the tables inherently flawed as metrics. The exchange highlights how paper promotion on social media favors engagement over rigor.