docs(day1): Added confidential ai talk notes
This commit is contained in:
parent
46f0fca196
commit
0a464e0dfd
@ -1,6 +1,6 @@
|
|||||||
# @niggl/kubecon25
|
# @niggl/cnsmunich25
|
||||||
|
|
||||||
My experiences at Cloud Native Rejekts and KubeCon + CloudNativeCon Europe 2025 in London.
|
My experiences at Cloud Native Summit 2025 in Munich.
|
||||||
|
|
||||||
## Quickstart 🐳
|
## Quickstart 🐳
|
||||||
|
|
||||||
|
58
content/day1/09_confidential.md
Normal file
58
content/day1/09_confidential.md
Normal file
@ -0,0 +1,58 @@
|
|||||||
|
---
|
||||||
|
title: Building a Confidential AI Inference Platform on Kubernetes
|
||||||
|
weight: 9
|
||||||
|
tags:
|
||||||
|
- security
|
||||||
|
- ai
|
||||||
|
---
|
||||||
|
|
||||||
|
<!-- {{% button href="https://youtu.be/rkteV6Mzjfs" style="warning" icon="video" %}}Watch talk on YouTube{{% /button %}} -->
|
||||||
|
<!-- {{% button href="https://docs.google.com/presentation/d/1nEK0CVC_yQgIDqwsdh-PRihB6dc9RyT-" style="tip" icon="person-chalkboard" %}}Slides{{% /button %}} -->
|
||||||
|
|
||||||
|
> Felt a bit like a showcase of their product's architecture - not bad, just nothing really to take home
|
||||||
|
|
||||||
|
Backgrund: How do we protect the data flowing into and out of our ai models?
|
||||||
|
|
||||||
|
## Goals
|
||||||
|
|
||||||
|
- Cloud based interference api
|
||||||
|
- E2E Encryption
|
||||||
|
- E2E Attestation
|
||||||
|
|
||||||
|
## Encryption Mechanisms
|
||||||
|
|
||||||
|
- Idea: Combine data at rest with data in transit and data in use encryption (encrypted memory)
|
||||||
|
- Attestation: CPU has a private key and issues certificates
|
||||||
|
|
||||||
|
## Confidential Containers
|
||||||
|
|
||||||
|
- Traditional: Full VM-based isolation
|
||||||
|
- Kubernetes: Advanced contaoiner isolation using virtual sockets and much more
|
||||||
|
- Implementation: Frameworks like contrast
|
||||||
|
|
||||||
|
### Threat model
|
||||||
|
|
||||||
|
- Isolated: Container
|
||||||
|
- Shared: Kubernetes, Hypervisor, Cloud Infra, Hardware
|
||||||
|
|
||||||
|
### Architecture
|
||||||
|
|
||||||
|
```mermaid
|
||||||
|
graph LR
|
||||||
|
User
|
||||||
|
User-->|Accesses with trust|AICode
|
||||||
|
User-->|Key exchange|SecretService-->|Key exchange|AICode
|
||||||
|
Manifest-->|Configure|ContrastCoordinator
|
||||||
|
subgraph Cluster
|
||||||
|
ContrastCoordinator(Contrast Coordinator)
|
||||||
|
ContrastCoordinator-->|Verify|Worker
|
||||||
|
subgraph Worker
|
||||||
|
AICode(AI Code)
|
||||||
|
AttestationAgent
|
||||||
|
end
|
||||||
|
AICode-->|Accesses|GPU
|
||||||
|
AttestationAgent-->|Verify|GPU
|
||||||
|
SecretService
|
||||||
|
end
|
||||||
|
ContrastCoordinator-->|Attest|User
|
||||||
|
```
|
Loading…
x
Reference in New Issue
Block a user