MazeBench is fully open source: any model with any harness can enter
xeophon · x · 2026-08-21
Responding to concerns that leaderboards only test frontier models with default harnesses, @xeophon clarified that MazeBench's code and all levels are fully open source—anyone can enter with any model and any harness, and the team will help you get it running. The author would love to see MazeBench conquered but doesn't think it will be solved any time soon.
Related event: MazeBench: Open-Source 3D Benchmark for Long-Horizon Agents(3 posts)→
More from Research
- UCSD Researchers Propose Dataset Watermarking Detectable via Black-Box API Access — yuxiangw_cs · 2026-10-16
- EmbodiedEvo tops RoboDojo as agents inherit reusable skills and lessons — Aiden_Tech_Ai · 2026-10-16
- CHI reviewer laments: papers' Discussion sections now cite nothing — IanArawjo · 2026-10-16
- Casper: Understanding 90% of neurons ≠ understanding the network — StephenLCasper · 2026-10-16
- NVIDIA Launches cuPotential in CUDA-X to Bring AI Agents to Semiconductor Materials Simulation — tomaszbednarz · 2026-10-16
- Agentic Search Systems Are Rewarded Only for Final Answers, Raising Faithfulness Concerns — burkov · 2026-10-16