Max Planck Institute Launches Comparity AI: A Human Preference Platform to Tackle Model Sycophancy
adam_alpha_finetuner · reddit · 2026-08-06
A Reddit user discussed the current pain points in LLM evaluation: while human preference leaderboards like LMSYS Chatbot Arena have been highly successful, they indirectly caused a 'sycophancy crisis' and overformatting in models. To address this, the Max Planck Institute for Intelligent Systems launched Comparity AI. The platform offers free access to frontier LLMs and generates a personalized leaderboard based on user interactions to help identify the best-suited model.
More from Models
- t0-alpha Released: Open-Source Foundation Model for Time-Series Forecasting — fpedregosa · 2026-08-06
- MiniMax Releases H3 Omni-Modal Model: Supports Video and Native Audio Generation — RisingSayak · 2026-08-06
- MiniMax Releases H3: 33B Open-Source DiT for Image, Video, and Audio — RisingSayak · 2026-08-06
- Google Wins Benchmarks But Loses Developers — prasenx · 2026-08-06
- OpenAI Reportedly Set to Launch Astra Next Week, Largest Pretrain Since GPT-4.5 — koltregaskes · 2026-08-06
- Google's August AI Build: 90 Reusable Agent Skills, Managed Infrastructure, New Gemini Models — rseroter · 2026-08-06