@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 23:15 UTC

main

[Bugfix] Fix w8a8 benchmarks for int8 case (#5643)

Tyler Michael Smith committed over 2 years ago

[Model] LoRA support added for command-r (#5178)

sergey-tinkoff committed over 2 years ago

[Misc] Add OpenTelemetry support (#4687)

Ronen Schaffer committed over 2 years ago

[ci] Deprecate original CI template (#5624)

Kevin H. Luu committed over 2 years ago

[Misc] Fix typo (#5618)

Cyrus Leung committed over 2 years ago

[misc][typo] fix typo (#5620)

youkaichao committed over 2 years ago

← Newer Page 1038 of 1120 Older →