A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 15, 09:45 UTC
[Misc] add lobe-chat support (#18177)
Signed-off-by: reidliu41 <reid201711@gmail.com> Co-authored-by: reidliu41 <reid201711@gmail.com>
Reid committed
May 15, 2025 at 13:02 UTC
2dff093574427b73f360342f2cf34af5328950a5
2 files changed
+14
docs/source/deployment/frameworks/index.md
+1
@@ -10,6 +10,7 @@ chatbox
10
dify
11
dstack
12
helm
13
+lobe-chat
14
lws
15
modal
16
open-webui
docs/source/deployment/frameworks/lobe-chat.md
new
+13
@@ -0,0 +1,13 @@
1
+(deployment-lobe-chat)=
2
+
3
+# Lobe Chat
4
+
5
+[Lobe Chat](https://github.com/lobehub/lobe-chat) is an open-source, modern-design ChatGPT/LLMs UI/Framework.
6
+
7
+Supports speech-synthesis, multi-modal, and extensible (function call) plugin system.
8
+
9
+One-click FREE deployment of your private OpenAI ChatGPT/Claude/Gemini/Groq/Ollama chat application.
10
+
11
+It supports vLLM as a AI model provider to efficiently serve large language models.
12
+
13
+For details, see the tutorial [Using vLLM in LobeChat](https://lobehub.com/docs/usage/providers/vllm).