SciConBench Team to Rerun Evaluations Every Two Months, Seeks Funding
manoelribeiro · x · 2026-10-07
The SciConBench team plans to run its evaluation every two months for the next 1-2 years, tracking new frontier models as they ship. They note that agent evaluations at this scale — and maintaining a live public leaderboard — are costly, hinting at a need for external funding.
Related event: SciConBench Plans Bi-monthly Eval Rounds, Seeks Funding(2 posts)→
More from Research
- CAVEAT testbed exposes how merchants can steer your shopping AI agent — ZacharyHuang12 · 2026-10-07
- GEA treats agent groups as the evolution unit, hitting 71% SWE-bench Verified with zero human help — xwang_lk · 2026-10-07
- 9B model fine-tuned with ~$25 of compute hits 79% of Jev's Decision Index score — sophiamyang · 2026-10-07
- Recovery skills lift real-robot task success from 77.5% to 87.5% in Recova — qinzytech · 2026-10-07
- Self-supervised learning automates thyroid cytology image feature analysis — zakkohane · 2026-10-07
- An excellent overview of AI watermarking and why it can't really be avoided — aronchick · 2026-10-07