xeophon commits to supporting independent evals with fully open-source tooling
xeophon · x · 2026-09-13
Responding to tenobrus and willcb's discussion on independent third-party evaluations, xeophon says the work referenced is what he does every single day, and that making these tools available to everyone and doing science in the open is "super important."
He states he is "100% down to help" and willing to extend his existing fully open-source tooling to more use cases in these areas — turning the abstract question of who runs neutral evals into a concrete offer of open tooling and labor.
Related event: Community Debates Path to Independent Third-Party AI Eval(3 posts)→
More from Research
- DeepSeek targets 'infinite context' and test-time parametric continual learning — teortaxesTex · 2026-09-13
- Circuit complexity is stuck — and AI could be the perfect adversarial partner to crack it — _onionesque · 2026-09-13
- DeepSeek researcher outlines direct path to test-time parametric continual learning — teortaxesTex · 2026-09-13
- Indie dev offers to train a fully open 9.4B dense model, tuned for a single GPU — NineThreeTilNow · 2026-09-13
- MIT prototype uses VLM and electrical muscle stimulation to move a human hand — Olivier__OG · 2026-09-13
- Ji, Lei, Zrnic revisit surrogate outcomes in the age of AI in Biometrika — lihua_lei_stat · 2026-09-13