Critic says viral AI interp demo was 'a bit of a bait': the prompt hinted the answer

mayfer · x · 2026-11-03

Quoting @giffmana's critique: an AI interpretability demo was "very cool but also a bit exaggerated." The prompt strongly hinted that looping was the issue and that finding neurons to fix it was the goal, and the author admitted the model couldn't otherwise improve at math. The project and website are great, but the tweet was bait — though it worked, as the critic read the whole page including prompts.

Original post →

More from Fun

Fun channel →