Researchers Prioritize Citation Quality
allen_ai · x · 2026-07-16
SciArena's results indicate that researchers value three main aspects in model answers:
- Citation quality: References that are real, relevant, and verifiable (23%)
- Depth (19%)
- Directly answering the question (16%)
By comparison, fluent writing alone isn't enough to win. SciArena is a researcher-driven evaluation for scientific literature Q&A, accumulating approximately 3,900 votes from around 1,700 users.
Related event: Allen AI retires SciArena; o3 tops the science-QA leaderboard(6 posts)→
More from Models
- Qwen3-8B gets a KV-approximation add-on that halves prefill time without touching the model — teortaxesTex · 2026-09-11
- Pro 20x tier burns 60% of weekly quota in under a day with GPT-6 Astra — rschu · 2026-09-11
- Google isn't honoring its own Gemini Grounded Search pricing: only 289 of 15,000+ requests counted as free — ItalyExpat · 2026-09-11
- Is DeepSeek's rumored K3 a scaled-down model, or something bigger? X users debate — teortaxesTex · 2026-09-11
- DeepSeek update keeps cache hits mid-conversation, cuts costs 36.6% — teortaxesTex · 2026-09-11
- 6TB of Fable data sold with leaked SSH keys, cloud creds tied to Xiaomi, Huawei, NIO — teortaxesTex · 2026-09-11