CuE: Activating and Suppressing Cultural Info in LLMs
simi_97k · x · 2026-07-12
Introduces the composition of Cultural Embeddings (CuE). Using Neuronpedia, the research team analyzed the sparse autoencoder features of the Gemma-2-9B model, discovering that cultural information within the model is shared, activated, and suppressed in an interpretable manner.
More from Research
- RSNA 2026 Deep Learning Labs return: eight hands-on AI classes over four days in Chicago — PRouzrokh · 2026-10-27
- Paper: data schedules and learning rate schedules should be designed together — alifcoder · 2026-10-27
- Health benchmark study: quality and diversity of eval items beat quantity — keunwoochoi · 2026-10-27
- Across 7 tasks, highest reasoning setting isn't the best for most open models — keunwoochoi · 2026-10-27
- Encrypted GPT-2 speedrun challenges FHE inference: best is 3.031 s/token, goal sub-1s — tensorqt · 2026-10-27
- Open Models Match GPT-6 on MedMCQA but Trail 17 Points on Hard Clinical Cases — keunwoochoi · 2026-10-27