Cohere launches confidential computing with encrypted inference; exec says rivals' ZDR labels are marketing
Nils_Reimers · x · 2026-11-21
- Cohere introduced confidential computing on its Model Vault: data stays encrypted all the way into GPU servers, with no plaintext existing anywhere in the pipeline — delivering genuine zero data retention (ZDR).
- Nils Reimers (Cohere) responded to complaints about ZDR promises being 'marketing labels rather than actual guarantees', bluntly stating that other providers' ZDR labels are often just marketing and shouldn't be trusted with sensitive data.
- Context: user @noctus91 argued that running AI locally is the only real way to retain data control, as inference providers' ZDR pledges look increasingly hollow.
More from Infra
- SpaceX lines up $44 billion GPU financing for Grok AI data centers — mark_k · 2026-11-21
- Researcher builds local GPU server to run 24/7 AI agent system after Mac mini runs out of memory — nodosenlared · 2026-11-21
- Custom engine runs Inkling 2 Mini at 129.5 tok/s with 344K context on a single RTX 3090, 2.3x faster than llama.cpp — teortaxesTex · 2026-11-21
- Counterintuitive: KV cache quantization in llama.cpp uses MORE VRAM than f16 — Fancy-Snow7 · 2026-11-21
- Gary Marcus shares chart of Oracle CDS spiking parabolically to record highs — GaryMarcus · 2026-11-21
- Can TEEs and Remote Attestation Make Decentralized GPUs Safe for Sensitive AI Workloads? — MrSwannn · 2026-11-21