A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 17, 06:45 UTC
Revert adding Megablocks (#2030)
Woosuk Kwon committed
Dec 11, 2023 at 10:49 UTC
beeee69bc92980c0cf70f9a733522641da0d08ec
1 file changed
-1
requirements.txt
-1
@@ -13,4 +13,3 @@ fastapi
13
uvicorn[standard]
14
pydantic == 1.10.13 # Required for OpenAI server.
15
aioprometheus[starlette]
16
-megablocks # Required for mixtral