Baseten's independent eval: Mirendil-Base-Large posts lowest bits per byte of all models tested
shayan_ · x · 2026-10-24
Mirendil asked Baseten to independently evaluate its new base models on private codebases the models had never seen. Mirendil-Base-Large achieved the lowest bits per byte (a tokenizer-independent perplexity measure) of any model tested. Baseten also announced it will serve as inference partner for Mirendil models.
Related event: Baseten Benchmarks Show Mirendil-Base-Large Beats Rivals on Perplexity(3 posts)→
More from Models
- Meta's Muse Spark Open hits ~150M tokens/s per MW on NVIDIA GB300 in early benchmarks — ArtificialAnlys · 2026-10-24
- OpenAI red team finds critical Brotli RCE (CVE-2026-11149) hitting Node.js, Bun, Envoy — moyix · 2026-10-24
- Kimi K3.1 falls short of benchmarks in hands-on testing, says KOL — DeryaTR_ · 2026-10-24
- Kimi K3.1 Pro tops agentic coding benchmarks but may lag on AA-3D — ArtificialAnlys · 2026-10-24
- ValsAI Index Finds Fireworks AI Beats DeepSeek and Moonshot's Own APIs on Agentic Tasks — sophiamyang · 2026-10-24
- TensorSharp hits 5.5× llama.cpp prefill throughput on DeepSeek V4.1 Flash across five A40s — fuzhongkai · 2026-10-24