main
md 5 lines 395 Bytes
Rendered Raw
1 # KAITO
2
3 [KAITO](https://kaito-project.github.io/kaito/docs/) is a Kubernetes operator that supports deploying and serving LLMs with vLLM. It offers managing large models via container images with built-in OpenAI-compatible inference, auto-provisioning GPU nodes and curated model presets.
4
5 Please refer to [quick start](https://kaito-project.github.io/kaito/docs/quick-start) for more details.