Muse senior engineer benchmark results pulled over flawed run, retest underway
danshipper · x · 2026-10-13
danshipper has taken down his tweet about Muse's performance on the senior engineer benchmark after discovering a problem in the test run, and plans to restart the evaluation. The previously shared Muse scores should be treated as unreliable until rerun results are out.
More from Models
- Dev says Codex is now 'nearly unusable': 4x slower than Opus 5.5 with worse results — TJLarkin23 · 2026-10-13
- oQe Quantization Update Cuts Code KL Divergence by Up to 18% Across 69 Models — huggingface · 2026-10-13
- Allen AI's TutorMoments Benchmark Finds LLM Tutors Over-Help Students — allen_ai · 2026-10-13
- DeepSeek's flash endpoint may be quietly testing a new model, users speculate v4.1-pro — teortaxesTex · 2026-10-13
- 3D game demos hint at AI creativity that transfers to CAD, docs and UI tasks — Angaisb_ · 2026-10-13
- subquadratic's New Model Beats Jev in 6 of 7 Production Use Cases Before Launch — ryanallred · 2026-10-13