@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 10:45 UTC

main

[Kernel] adding fused moe kernel config for L40S TP4 (#9245)

Burkhard Ringlein committed about 2 years ago

[Model] Support Mamba (#6484)

Tyler Michael Smith committed about 2 years ago

[Bugfix] Fix priority in multiprocessing engine (#9277)

Sebastian Schoennenbeck committed about 2 years ago

[misc] hide best_of from engine (#9261)

youkaichao committed about 2 years ago

[torch.compile] generic decorators (#9258)

youkaichao committed about 2 years ago

Bump actions/setup-python from 3 to 5 (#9195)

dependabot[bot] committed about 2 years ago

Bump actions/checkout from 3 to 4 (#9196)

dependabot[bot] committed about 2 years ago

Bump actions/github-script from 6 to 7 (#9197)

dependabot[bot] committed about 2 years ago

[Doc] Improve debugging documentation (#9204)

Rafael Vasquez committed about 2 years ago

← Newer Page 972 of 1120 Older →