@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 05:45 UTC

main

[Core] Support Lark grammars for XGrammar (#10870)

Michael Goin committed almost 2 years ago

[torch.compile] fix deprecated code (#10948)

youkaichao committed almost 2 years ago

[CI/Build] Fix broken multimodal test (#10950)

Cyrus Leung committed almost 2 years ago

[CI/Build] Bump test transformers version (#10106)

Isotr0py committed almost 2 years ago

[Bugfix] Fix BNB loader target_modules (#10720)

Jee Jee Li committed almost 2 years ago

[Doc] Create a new "Usage" section (#10827)

Cyrus Leung committed almost 2 years ago

[benchmark] Make H100 benchmark optional (#10908)

Kevin H. Luu committed almost 2 years ago

[CI/Build] improve python-only dev setup (#9621)

Daniele committed almost 2 years ago

Benchmark serving structured output (#10880)

Chendi.Xue committed almost 2 years ago

[LoRA] Change lora_tokenizers capacity (#10796)

Xin Yang committed almost 2 years ago

[ci/build] Update vLLM postmerge ECR repo (#10887)

Kevin H. Luu committed almost 2 years ago

← Newer Page 936 of 1120 Older →