IDEA-FinAI releases TB-MathModel: first agentic, verifiable math modeling benchmark
IDEA-FinAI · hf · 2026-11-07
IDEA-FinAI released TB-MathModel on Hugging Face, a terminal-style benchmark billed as the first agentic and verifiable benchmark for mathematical modeling. It wraps complete contest-style modeling problems into terminal tasks; scoring compares the agent's final numeric answers against multiple human references with feasibility checks, making open-ended modeling problems automatically and objectively gradeable.
More from Research
- Regularization can amplify subliminal learning, surprising AI safety finding — AdtRaghunathan · 2026-11-07
- OpenVax revamps personalized cancer vaccine toolkit; OpenVax2 adds long-read support — iskander · 2026-11-07
- Google's Muir linear attention fits 10M tokens in a 25MB state, beats GDN-2 — CategoryNormal149 · 2026-11-07
- Ollama's prompt cache changes LLM outputs even at temperature 0 with fixed seed — Full-Travel857 · 2026-11-07
- OpenAI launches BioBasicsBench: 100 real wet-lab tasks to stress-test AI agents — OpenAI · 2026-11-07
- Scaling systolic array diagrams from 8x8 to 64x64: 4096 PE matrix multiply visualized — satnam6502 · 2026-11-07