AI paper-replication prompt: 7/10 finds data problems, 3/10 simple baselines win

generativist · x · 2026-10-22

@generativist shares his go-to review prompt: ask an AI to replicate a paper, compare it to the simplest baseline model with sufficient capacity for the problem, and produce a summary table of findings. His informal scorecard: 7/10 times the AI finds a data problem with the paper; 3/10 times the simpler method works better. "You people love to complicate things," he quips.

Related event: Viral AI review prompt: reproduce papers, compare against simplest baseline(2 posts)→

Original post →

More from Fun

Fun channel →