Experiment Claims Posing as Karpathy Boosts Gemini Output, Data Open-Sourced

A controlled experiment by Dan Petrovic found that setting the username to "Karpathy" made Gemini score 7.8 vs 5.8 in blind reviews of 225 expert-task answers. DEJAN has now released an interactive dashboard and the full dataset.

2026-11-12 ~ 2026-11-12 · 2 related posts

• Telling Gemini you're Karpathy makes it think 30% longer and score 7.8 vs 5.8 in blind test — dejanseo · 2026-11-12
• DEJAN open-sources full data behind its Gemini expert-name experiment: 225 blind-rated answers — dejanseo · 2026-11-12