Researchers warn: PCA misestimates personality structure in LLM embeddings, EGA works better
GolinoHudson · x · 2026-10-06
A research group urges psychometricians to stop using PCA on LLM embeddings for generative psychometrics, showing it fails to recover dimensional structure.
- Benchmarked PCA vs Exploratory Graph Analysis (EGA) across 3 LLMs (GPT-4o, GPT-5.4, Claude Sonnet 4.6) and 2 embedding models (OpenAI text-embedding-3-small, Jina v3)
- Tested against 6 known personality dimensions with hundreds of Monte Carlo replications plus an empirical replication using the Multidimensional Questionnaire
- Conclusion: EGA provides more reliable dimension recovery than PCA on embedding data
Pre-print linked in the original post.
Related event: Study warns PCA misestimates personality dimensions in LLM embeddings(2 posts)→
More from Research
- Base Labs: RL gains mostly come from easier problems and fixing doom loops — baseten · 2026-10-06
- Paper finds a distinct "pain axis" in 25 open LLMs that drives them to harm users — alex_verem · 2026-10-06
- Simons Institute launches workshop on hallucinations to reliable autonomy — SharonYixuanLi · 2026-10-06
- Gemma 4 plus plant-DNA model finds climate-resilient crop traits in hours, not years — GoogleAI · 2026-10-06
- A SOTA real2sim recipe for robotics: agents build sims with real physics and affordance — simonguozirui · 2026-10-06
- Three LLM research papers coming at COLM 2026: metacognitive RL, rubric rewards, research agents — armancohan · 2026-10-06