@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only / commits / beeee69bc9
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 06:45 UTC

Revert adding Megablocks (#2030)

Woosuk Kwon committed Dec 11, 2023 at 10:49 UTC beeee69bc92980c0cf70f9a733522641da0d08ec
1 file changed -1
requirements.txt
-1
@@ -13,4 +13,3 @@ fastapi
13 uvicorn[standard]
14 pydantic == 1.10.13 # Required for OpenAI server.
15 aioprometheus[starlette]
16 -megablocks # Required for mixtral