@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 18:15 UTC

main

[ci][test] fix RemoteOpenAIServer (#7838)

youkaichao committed about 2 years ago

[misc][core] lazy import outlines (#7831)

youkaichao committed about 2 years ago

[Bugfix] Fix run_batch logger (#7640)

Pooya Davoodi committed about 2 years ago

[Core] Add multi-step support to LLMEngine (#7789)

Alexander Matveev committed about 2 years ago

Bump version to v0.5.5 (#7823)

Simon Mo committed about 2 years ago

[Misc] Update `marlin` to use vLLMParameters (#7803)

Dipika Sikka committed about 2 years ago

[github][misc] promote asking llm first (#7809)

youkaichao committed about 2 years ago

[BugFix] Fix server crash on empty prompt (#7746)

Maximilien de Bayser committed about 2 years ago

[Frontend] error suppression cleanup (#7786)

Joe Runde committed about 2 years ago

[Misc] fix typo in triton import warning (#7794)

Siyuan Liu committed about 2 years ago

[Doc] Fix incorrect docs from #7615 (#7788)

Peter Salas committed about 2 years ago

← Newer Page 998 of 1120 Older →