main
md 14 lines 815 Bytes
Rendered Raw
1 # KubeAI
2
3 [KubeAI](https://github.com/substratusai/kubeai) is a Kubernetes operator that enables you to deploy and manage AI models on Kubernetes. It provides a simple and scalable way to deploy vLLM in production. Functionality such as scale-from-zero, load based autoscaling, model caching, and much more is provided out of the box with zero external dependencies.
4
5 Please see the Installation Guides for environment specific instructions:
6
7 - [Any Kubernetes Cluster](https://www.kubeai.org/installation/any/)
8 - [AKS](https://www.kubeai.org/installation/aks/)
9 - [EKS](https://www.kubeai.org/installation/eks/)
10 - [GKE](https://www.kubeai.org/installation/gke/)
11
12 Once you have KubeAI installed, you can
13 [configure text generation models](https://www.kubeai.org/how-to/configure-text-generation-models/)
14 using vLLM.