A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 17, 06:45 UTC
Update requirements.txt for mixtral (#2029)
Ram committed
Dec 12, 2023 at 00:09 UTC
9bf28d0b69c8a01627643305d7821dc42b21b38d
1 file changed
+1
requirements.txt
+1
@@ -13,3 +13,4 @@ fastapi
13
uvicorn[standard]
14
pydantic == 1.10.13 # Required for OpenAI server.
15
aioprometheus[starlette]
16
+megablocks # Required for mixtral