@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 07:00 UTC

main

[Misc] Consolidate pooler config overrides (#10351)

Cyrus Leung committed about 2 years ago

[bugfix] Fix static asymmetric quantization case (#10334)

Luka Govedič committed about 2 years ago

[Bugfix] Fix unable to load some models (#10312)

Cyrus Leung committed about 2 years ago

[Tool parsing] Improve / correct mistral tool parsing (#10333)

Patrick von Platen committed about 2 years ago

[Perf] Reduce peak memory usage of llama (#10339)

Murali Andoorveedu committed about 2 years ago

Support Roberta embedding models (#9387)

Maximilien de Bayser committed about 2 years ago

[Docs] Publish meetup slides (#10331)

Woosuk Kwon committed about 2 years ago

[CI/Build] Make shellcheck happy (#10285)

Cyrus Leung committed about 2 years ago

[ci][distributed] disable hanging tests (#10317)

youkaichao committed about 2 years ago

[Frontend] Pythonic tool parser (#9859)

Mike Depinet committed about 2 years ago

[Misc] format.sh: Simplify tool_version_check (#10305)

Russell Bryant committed about 2 years ago

[misc] error early for old-style class (#10304)

youkaichao committed about 2 years ago

← Newer Page 949 of 1120 Older →