Avoid overwriting vllm_compile_cache.py (#17418)

Keyun Tong committed over 1 year ago

[BugFix] Fix mla cpu - missing 3 required positional arguments (#17494)

Lucas Wilkinson committed over 1 year ago

[BugFix] fix speculative decoding memory leak when speculation is disabled (#15506)

Noah Yoshida committed over 1 year ago

[ROCm] Effort to reduce the number of environment variables in command line (#17229)

Hongxia Yang committed over 1 year ago

[Build] Require setuptools >= 77.0.3 for PEP 639 (#17389)

Russell Bryant committed over 1 year ago

FIxing the AMD test failures caused by PR#16457 (#17511)

Alexei-V-Ivanov-AMD committed over 1 year ago

[CI/Build] Reorganize models tests (#17459)

Cyrus Leung committed over 1 year ago

[CI][Bugfix] Fix failing V1 Test due to missing 'cache_salt' arg (#17500)

Michael Goin committed over 1 year ago

[CI][TPU] Skip structured outputs+spec decode tests on TPU (#17510)

Michael Goin committed over 1 year ago

[Bugfix] Temporarily disable gptq_bitblas on ROCm (#17411)

NaLan ZeYu committed over 1 year ago

[Bugfix][ROCm] Fix import error on ROCm (#17495)

Gregory Shtrasberg committed over 1 year ago

[CI][TPU] Skip Multimodal test (#17488)

Siyuan Liu committed over 1 year ago

[Misc] Rename Audios -> Audio in Qwen2audio Processing (#17507)

Alex Brooks committed over 1 year ago

Bump Compressed Tensors version to 0.9.4 (#17478)

Rahul Tuli committed over 1 year ago

[v1][Spec Decode] Make sliding window compatible with eagle prefix caching (#17398)

Chen Zhang committed over 1 year ago

doc: fix bug report Github template formatting (#17486)

David Xia committed over 1 year ago

[doc] add install tips (#17373)

Reid committed over 1 year ago

[Bugfix][ROCm] Restrict ray version due to a breaking release (#17480)

Gregory Shtrasberg committed over 1 year ago

[BugFix] Fix authorization of openai_transcription_client.py (#17321)

zh Wang committed over 1 year ago

[Docs] Update optimization.md doc (#17482)

Michael Goin committed over 1 year ago