534 B
534 B
title | weight | tags | ||
---|---|---|---|---|
Sponsored: Build an open source platform for ai/ml | 4 |
|
Jorge Palma from Microsoft with a quick introduction.
Baseline
- Kubernetes is cool and all
- Challenges:
- Containerized models
- GPUs in the cluster (install, management)
Kubernetes AI Toolchain (KAITO)
- Kubernetes operator that interacts with
- Node provisioner
- Deployment
- Simple CRD that decribes a model, infra and have fun
- Creates inferance endpoint
- Models are currently 10 (Hugginface, LLMA, etc)