LLMs show a surprising ‘ghost’ self-feature in multiple models
voooooogel · x · 2026-07-25
This repost discusses a mechanistic-interpretability finding: “ghost” is a surprisingly salient self-feature in multiple LLMs, including Llama 3.3 70B and Claude Sonnet 3.0.
The attached slides show that when models are steered away from more obvious concepts like “artificially created” or “robot,” a latent concept related to immaterial beings—ghosts, souls, angels—can emerge. The speaker argues this may reflect a broader pattern in LLM identity features, where the model’s self-description shifts toward spectral or non-physical language under steering.
More from Research
- Proto-tools, a universal infrastructure layer for generative biology, now open source — jmschreiber91 · 2026-10-26
- New paper finds AI agents negotiate badly under uncertainty and break deals on purpose — xuanalogue · 2026-10-26
- MCP fault injection study: agent task scores drop 60% under realistic tool failures, scale doesn't help — dair_ai · 2026-10-26
- Study: AI reviewing AI misses most reward hacking; best models miss 25%+ of hacks — ronbodkin · 2026-10-26
- FLUX.3 Klein step-distilled to 4-8 steps with CFG baked in — Fit-Structure-6489 · 2026-10-26
- NLI alone rejects 5/6 new agent memories; a 0.45 similarity gate fixes it all — Alternative_Pin9598 · 2026-10-26