Discounted API relay stations lack prompt caching, making long sessions pricier
uneatenbreakfast · reddit · 2026-11-02
A developer found that Chinese API relay stations offering 50-90% off official prices mostly lack upstream prompt caching, so every hit bills the full input price as context grows — brutal for AI coding with long sessions. The discounted sticker price may cost far more in total tokens, and the poster asks whether any relays support prompt caching. A practical reminder to check cache passthrough when comparing API prices.
More from Models
- Nanbeige4.3-33B lands on Hugging Face, pitched as a Qwen rival — amaarora · 2026-11-02
- A4 print-ready PDF stress test: only Claude, Gemini and Mistral pass out of 10 AI models — gerardsans · 2026-11-02
- Google open-sources EmbeddingGemma 2: on-device multimodal search across photos, audio, docs — bigaiguy · 2026-11-02
- Anthropic's server-side rule reignites the case for owning open models over renting AI — alex_verem · 2026-11-02
- Epoch AI: open-weight GLM 5.3 exploited the patch gap to hack 6 Firefox releases at ~$1,000 each — rohanpaul_ai · 2026-11-02
- SemiAnalysis: safety classifiers sandbag scores of Opus 5.5 and GPT-6 Astra — morqon · 2026-11-02