2024-03-20 09:42:54 +00:00
|
|
|
---
|
2024-03-20 15:58:50 +00:00
|
|
|
title: "Sponsored: Build an open source platform for ai/ml"
|
2024-03-20 09:42:54 +00:00
|
|
|
weight: 4
|
2024-03-25 12:45:10 +00:00
|
|
|
tags:
|
|
|
|
|
- keynote
|
|
|
|
|
- ai
|
2024-03-20 09:42:54 +00:00
|
|
|
---
|
|
|
|
|
|
|
|
|
|
Jorge Palma from Microsoft with a quick introduction.
|
|
|
|
|
|
|
|
|
|
## Baseline
|
|
|
|
|
|
|
|
|
|
* Kubernetes is cool and all
|
|
|
|
|
* Challenges:
|
|
|
|
|
* Containerized models
|
|
|
|
|
* GPUs in the cluster (install, management)
|
|
|
|
|
|
|
|
|
|
## Kubernetes AI Toolchain (KAITO)
|
|
|
|
|
|
|
|
|
|
* Kubernetes operator that interacts with
|
|
|
|
|
* Node provisioner
|
|
|
|
|
* Deployment
|
|
|
|
|
* Simple CRD that decribes a model, infra and have fun
|
|
|
|
|
* Creates inferance endpoint
|
|
|
|
|
* Models are currently 10 (Hugginface, LLMA, etc)
|
