Merge Gateway Launches Batch Inference at ~50% of Standard Prices
shensi · x · 2026-09-25
Merge Gateway launched batch inference: submit up to 10,000 requests in one job, routed to provider batch APIs (Anthropic, OpenAI), finishing within 24 hours at typically 50% of standard pricing. Suited for evals, backfills, classification, document processing, and embeddings. Billing is per-line with individual retries — errored, expired, or cancelled lines cost nothing. Docs expose an /llms.txt index for agents.
More from Infra
- Docker launches Cloud Sandboxes: microVM isolation for always-on agents, $250 credit — juntao · 2026-09-25
- Muse Spark 1.3 Now Available via Oracle, in Private Preview on Google Cloud — alexandr_wang · 2026-09-25
- Andy Matuschak: Modern Chips Are Too Durable for Compute-Control-Based AI Governance to Hold — andy_matuschak · 2026-09-25
- Qualcomm touts double-digit MLPerf performance and efficiency gains at Snapdragon Summit — samcharrington · 2026-09-25
- HEIF Heist: image parser RCE chain nets $100k Meta bounty, hits OpenAI repos and more — evilsocket · 2026-09-25
- Using Jev-style system-1 models as a cheap calibrated decision layer for Bittensor validators — markjeffrey · 2026-09-25