Inference provider details TPM signing, confidential compute, and per-user KV cache isolation

sloppenheimer · x · 2026-11-23

sloppenheimer outlines his inference service's security stance: confidential compute, TPM signing down to weights, and zero data retention — including an obsession with preventing KV cache leaks between users, a detail most providers never think about. A useful checklist for evaluating open-model hosting providers.

Related event: Practitioner shares lessons on GPU inference co-ops and privacy(2 posts)→

Original post →

More from Infra

Infra channel →