Liquid AI Releases Pipette, Open Source Benchmark for On-Device AI Models
JosephJacks_ · x · 2026-08-25
Liquid AI, in partnership with Artificial Analysis, has released Pipette, an open-source model evaluation suite specifically designed for on-device intelligence.
Key Features:
- Unlike platforms optimized for cloud-served models, Pipette measures quality, speed, latency, and memory usage on phones, laptops, PCs, AI boxes, and embedded hardware.
- Provides a unified interface to compare combinations of models, quantizations, runtimes, and devices.
- Includes a warehouse of 10k+ verified benchmark results across 35 model classes, 7 quantization types, and runtimes like llama.cpp.
More from Models
- Model at capacity for a straight week drives frustrated dev back to Opus — joonasvirtanen · 2026-10-16
- Decision models match LLMs on routing and safety — and are 7-8x faster — randal_olson · 2026-10-16
- Xiaomi MiMo V2.6 Pro takes #1 open-model spot on Agent Arena at $0.11/task — arena · 2026-10-16
- ChatGPT's 'best AI video tool' answer points to Runway integration, sparking ad doubts — tlakomy · 2026-10-16
- Microsoft's MAI finishes in-house 3T-parameter pretrained base models, post-training results coming — soumitrashukla9 · 2026-10-16
- Hands-on with Gemini 4 Argon: faster than Opus 5.5 but hallucinates more and costs more — prasenx · 2026-10-16