Why it matters

Encrypted inference enables sensitive data use. Understanding shapes deployment.

Advertisement

The architecture

Client encrypts input.

Confidential VM + GPU decrypts inside TEE.

Encrypted result to client.

Encrypted inference flowEncrypted inputclient-sideTEE decrypt + inferconfidential computeEncrypted outputback to clientFull chain: client encryption + TEE processing + confidential GPU + result encryption
Encrypted inference.
Advertisement

How it works end to end

Client key wraps input.

TEE attestation gates key release.

Inference inside TEE.

Encrypted output.