Removing three principal components collapses frontier model accuracy from 95.7% to 54.6%

kalomaze · x · 2026-11-01

kalomaze shares a fun interpretability experiment: there's a sharp knee at removing three leading principal components after normalization — removing two leaves 95.7% accuracy / 0.992 AUROC, while removing three drops to 54.6% / 0.518. The author jokes that their goal is sometimes to trigger the "this fucking guy" interp circuit in frontier models.

Original post →

More from Fun

Fun channel →