MazeBench is fully open source: any model with any harness can enter
xeophon · x · 2026-08-21
Responding to concerns that leaderboards only test frontier models with default harnesses, @xeophon clarified that MazeBench's code and all levels are fully open source—anyone can enter with any model and any harness, and the team will help you get it running. The author would love to see MazeBench conquered but doesn't think it will be solved any time soon.
Related event: MazeBench launches as open long-horizon agent benchmark(2 posts)→
More from Research
- τ0-VLA: Hierarchical Robot Foundation Model with World-Model-Guided Test-Time Search — sii-research · 2026-08-22
- ITSMBench Open Sourced: 50 Tasks for Multi-turn Agent Evaluation — Shahules786 · 2026-08-22
- Recursion releases Nesso: 10x faster binding affinity model for drug discovery — anshulkundaje · 2026-08-22
- Interview with Owain Evans explores emergent misalignment and LLM persona safety — sjgadler · 2026-08-22
- NVIDIA & Berkeley open source tactile robotics method T-Rex — DrJimFan · 2026-08-22
- Lightwheel and Hugging Face release 100k-hour human manipulation dataset — vanstriendaniel · 2026-08-22