@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 15, 23:30 UTC

main

[CI/Build] Allow ruff to auto-fix some issues (#13180)

Russell Bryant committed almost 2 years ago

Allow Unsloth Dynamic 4bit BnB quants to work (#12974)

Daniel Han committed almost 2 years ago

[Frontend] Move CLI code into vllm.cmd package (#12971)

Russell Bryant committed almost 2 years ago

[NVIDIA] Support nvfp4 quantization (#12784)

Kaixi Hou committed almost 2 years ago

[CI/Build] Ignore ruff warning up007 (#13182)

Russell Bryant committed almost 2 years ago

[CI] Fix failing FP8 cpu offload test (#13170)

Michael Goin committed almost 2 years ago

[CI/Build] Use mypy matcher for pre-commit CI job (#13162)

Russell Bryant committed almost 2 years ago

[Misc] Delete unused LoRA modules (#13151)

Jee Jee Li committed almost 2 years ago

← Newer Page 892 of 1120 Older →