@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 18:15 UTC

main

Revert #7509 (#7887)

Cody Yu committed about 2 years ago

[Core] Asynchronous Output Processor (#7049)

Megha Agarwal committed about 2 years ago

[Bugfix] neuron: enable tensor parallelism (#7562)

omrishiv committed about 2 years ago

[Misc] Update `qqq` to use vLLMParameters (#7805)

Dipika Sikka committed about 2 years ago

[Bugfix]: Use float32 for base64 embedding (#7855)

ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟 committed about 2 years ago

[misc][cuda] improve pynvml warning (#7852)

youkaichao committed about 2 years ago

← Newer Page 997 of 1120 Older →