docs(day1): Added confidential ai talk notes
This commit is contained in:
parent
46f0fca196
commit
0a464e0dfd
@ -1,6 +1,6 @@
|
||||
# @niggl/kubecon25
|
||||
# @niggl/cnsmunich25
|
||||
|
||||
My experiences at Cloud Native Rejekts and KubeCon + CloudNativeCon Europe 2025 in London.
|
||||
My experiences at Cloud Native Summit 2025 in Munich.
|
||||
|
||||
## Quickstart 🐳
|
||||
|
||||
|
58
content/day1/09_confidential.md
Normal file
58
content/day1/09_confidential.md
Normal file
@ -0,0 +1,58 @@
|
||||
---
|
||||
title: Building a Confidential AI Inference Platform on Kubernetes
|
||||
weight: 9
|
||||
tags:
|
||||
- security
|
||||
- ai
|
||||
---
|
||||
|
||||
<!-- {{% button href="https://youtu.be/rkteV6Mzjfs" style="warning" icon="video" %}}Watch talk on YouTube{{% /button %}} -->
|
||||
<!-- {{% button href="https://docs.google.com/presentation/d/1nEK0CVC_yQgIDqwsdh-PRihB6dc9RyT-" style="tip" icon="person-chalkboard" %}}Slides{{% /button %}} -->
|
||||
|
||||
> Felt a bit like a showcase of their product's architecture - not bad, just nothing really to take home
|
||||
|
||||
Backgrund: How do we protect the data flowing into and out of our ai models?
|
||||
|
||||
## Goals
|
||||
|
||||
- Cloud based interference api
|
||||
- E2E Encryption
|
||||
- E2E Attestation
|
||||
|
||||
## Encryption Mechanisms
|
||||
|
||||
- Idea: Combine data at rest with data in transit and data in use encryption (encrypted memory)
|
||||
- Attestation: CPU has a private key and issues certificates
|
||||
|
||||
## Confidential Containers
|
||||
|
||||
- Traditional: Full VM-based isolation
|
||||
- Kubernetes: Advanced contaoiner isolation using virtual sockets and much more
|
||||
- Implementation: Frameworks like contrast
|
||||
|
||||
### Threat model
|
||||
|
||||
- Isolated: Container
|
||||
- Shared: Kubernetes, Hypervisor, Cloud Infra, Hardware
|
||||
|
||||
### Architecture
|
||||
|
||||
```mermaid
|
||||
graph LR
|
||||
User
|
||||
User-->|Accesses with trust|AICode
|
||||
User-->|Key exchange|SecretService-->|Key exchange|AICode
|
||||
Manifest-->|Configure|ContrastCoordinator
|
||||
subgraph Cluster
|
||||
ContrastCoordinator(Contrast Coordinator)
|
||||
ContrastCoordinator-->|Verify|Worker
|
||||
subgraph Worker
|
||||
AICode(AI Code)
|
||||
AttestationAgent
|
||||
end
|
||||
AICode-->|Accesses|GPU
|
||||
AttestationAgent-->|Verify|GPU
|
||||
SecretService
|
||||
end
|
||||
ContrastCoordinator-->|Attest|User
|
||||
```
|
Loading…
x
Reference in New Issue
Block a user