@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 17:00 UTC

main

[Misc] Fused MoE Marlin support for GPTQ (#8217)

Dipika Sikka committed about 2 years ago

[Misc] GPTQ Activation Ordering (#8135)

Kyle Sayers committed about 2 years ago

[Bugfix] Correct adapter usage for cohere and jamba (#8292)

Vladislav Kruglikov committed about 2 years ago

[Frontend] Add progress reporting to run_batch.py (#8060)

Adam Lugowski committed about 2 years ago

[Bugfix] Fix async postprocessor in case of preemption (#8267)

Alexander Matveev committed about 2 years ago

[CI/Build] Use python 3.12 in cuda image (#8133)

Joe Runde committed about 2 years ago

[Bugfix] Fix broken OpenAI tensorizer test (#8258)

Cyrus Leung committed about 2 years ago

[tpu][misc] fix typo (#8260)

youkaichao committed about 2 years ago

[Model] Multi-input support for LLaVA (#8238)

Cyrus Leung committed about 2 years ago

[Bugfix] Fix Hermes tool call chat template bug (#8256)

Kyle Mistele committed about 2 years ago

[Model] Allow loading from original Mistral format (#8168)

Patrick von Platen committed about 2 years ago

[Misc] Remove `SqueezeLLM` (#8220)

Dipika Sikka committed about 2 years ago

← Newer Page 991 of 1120 Older →