Liquid AI releases Pipette, an open-source benchmark for on-device AI models
JosephJacks_ · x · 2026-08-25
Liquid AI, in partnership with Artificial Analysis, has released Pipette, an open-source evaluation suite designed specifically for measuring AI model performance on edge devices like phones, laptops, and AI boxes.
- On-device focus: Addresses the gap in existing cloud-centric benchmarks by providing a common way to measure quality, speed, latency, and memory usage locally.
- Comprehensive data: Includes a warehouse of 10,000+ verified results spanning 35 model classes, 7 quantization types, and runtimes like llama.cpp.
More from Infra
- Lovable hits 250 repos/sec peak using Code.Storage for AI coding infra — dhruv2038 · 2026-08-25
- SpaceX's space data center concept simplifies to chips, power, and cooling — XFreeze · 2026-08-25
- NVIDIA splits agentic AI workloads across Rubin GPUs, Groq LPX and Vera CPUs — rohanpaul_ai · 2026-08-25
- AI Data Centers Face Local Resistance: Jobs Needed as Energy Costs Rise — dbasch · 2026-08-25
- Nvidia spending $6B to build US alternative to Chinese AI — abhishekcode42 · 2026-08-25
- NVIDIA's Vera CPU charts criticized for misleading comparisons against older AMD chips — zephyr_z9 · 2026-08-25