Open-source repo shares 20 exploratory NCM and GPT-2 interpretability studies

BedFalse6021 · reddit · 2026-10-28

An independent open-source repo collects 20 exploratory studies on Next-Concept Modeling (NCM), mechanistic interpretability (like IOI in GPT-2), and model controls, including NCM on structured tasks like Sudoku and toy parallel models. All source code, saved results, and per-run interpretations are included, with honest categorization of mixed and fully negative outcomes — "no performance breakthroughs, just honest documentation." AI tools were heavily used in planning and coding. Feedback welcome on setups and interpretation limits.

Related event: Independent Researcher Open-Sources 20 Next-Concept Modeling and GPT-2 Interpretability Experiments(2 posts)→

Original post →

More from Research

Research channel →