Presentation on weird, creative ideas for evaluating AI benchmarks
mariofilhoml · x · 2026-08-26
A presentation showcasing various unconventional and creative ideas for designing AI benchmarks.
More from Research
- Latency reduction in MoE models comes at high cost — firstadopter · 2026-08-26
- Artificial Analysis Introduces Reward Hacking Corrections to Coding Agent Index — ArtificialAnlys · 2026-08-26
- Qwen3.8-27B runs 100k-token physics simulation on a 16GB GPU — 1000_bucks_a_month · 2026-08-26
- Study: Can AI Antibody Design Beat CDR Consensus? — anshulkundaje · 2026-08-26
- Bearish on Neolabs, positive on Core team amid Transformer fatigue — apples_jimmy · 2026-08-26
- Paper Hypothesizes Specific Reward Hack Could Break AI Evaluations — nabla_theta · 2026-08-26