@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 09:30 UTC

main

[CI/Build] Add error matching for ruff output (#9513)

Russell Bryant committed about 2 years ago

:bug: fix torch memory profiling (#9516)

Joe Runde committed about 2 years ago

[MISC] Add lora requests to metrics (#9477)

Kunjan committed about 2 years ago

[CI/Build] Add error matching config for mypy (#9512)

Russell Bryant committed about 2 years ago

[Misc] benchmark: Add option to set max concurrency (#9390)

Russell Bryant committed about 2 years ago

[Bugfix] Fix offline_inference_with_prefix.py (#9505)

Tyler Michael Smith committed about 2 years ago

[Frontend][Feature] Add jamba tool parser (#9154)

tomeras91 committed about 2 years ago

[Qwen2.5] Support bnb quant for Qwen2.5 (#9467)

Haoyu Wang committed about 2 years ago

← Newer Page 968 of 1120 Older →