@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 01:45 UTC

main

[CI] Make mistral tests pass (#4596)

SangBin Cho committed over 2 years ago

[Core] Optimize sampler get_logprobs (#4594)

SangBin Cho committed over 2 years ago

[Build/CI] Fixing 'docker run' to re-enable AMD CI tests. (#4642)

Alexei-V-Ivanov-AMD committed over 2 years ago

[Kernel] Make static FP8 scaling more robust (#4570)

Philipp Moritz committed over 2 years ago

Update lm-format-enforcer to 0.10.1 (#4631)

Noam Gat committed over 2 years ago

[CI] Add retry for agent lost (#4633)

Cade Daniel committed over 2 years ago

Disable cuda version check in vllm-openai image (#4530)

zhaoyang-star committed over 2 years ago

bump version to v0.4.2 (#4600)

Simon Mo committed over 2 years ago

[CI] check size of the wheels (#4319)

Simon Mo committed over 2 years ago

← Newer Page 1056 of 1120 Older →