Georgetown's AI referee leaderboard scores top 100 econ papers with Claude
dfinke · x · 2026-09-07
Georgetown University launched an AI Referee Paper Leaderboard that uses Claude Opus 4.8 as an AI referee against a fixed rubric to score the top 100 finance and economics working papers. Each paper gets a full report across dimensions like significance, originality, correctness, data & methodology, and exposition — AIs retroactively auditing published research and sharing judgments publicly.
More from Research
- New tendon-based robotic hand designs trained with PPO to learn one-armed catch — _krishna_murthy · 2026-10-23
- Google QuantumAI and Kaggle launch $150K verifiable quantum circuit compilation competition — JFPuget · 2026-10-23
- Diffusion LLM bias rankings shift with sampling configs, persist after debiasing — Bollegala · 2026-10-23
- Aggregating lab tokenizers reveals ~994 tokens stable across Google, DeepSeek, Meta, Anthropic — kalomaze · 2026-10-23
- Researcher uses Grok to hunt LLM-driven UAE bot network on X with self-written prompts — FlorianGallwitz · 2026-10-23
- Dev converts Qwen3-0.6B into a MoE model: quality drops and no speed gain at this scale — Bayliner1980 · 2026-10-23