Cohere launches Confidential Computing in Model Vault: encrypted even during inference

cohere · x · 2026-09-17

Cohere introduced Confidential Computing in Model Vault, addressing data 'in use' — previously only encrypted at rest and in transit, inference exposed data to the provider. Now even Cohere cannot access customer workloads. Three mechanisms: end-to-end encrypted inference, hardware-enforced isolation extending to the GPU via NVIDIA Confidential Computing, and a signed attestation token independently verifiable against hardware vendors' public keys.

Related event: Cohere Brings Confidential Computing to Model Vault(3 posts)→

Original post →

More from Models

Models channel →