A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 15, 04:45 UTC
main
[Model] GPT2ForSequenceClassification model (#19663)
Adrian committed over 1 year ago
[Fix] import regex instead of re (#19875)
Thomas Parnell committed over 1 year ago
[Kernel] correct cpu worker function parameter type (#19745)
Ning Xie committed over 1 year ago
[Misc] refactor example - openai_transcription_client (#19851)
Reid committed over 1 year ago
[Misc] update cuda version (#19526)
Reid committed over 1 year ago
[Bugfix][Ray] Set the cuda context eagerly in the ray worker (#19583)
kourosh hakhamaneshi committed over 1 year ago
[Bugfix] Enable PP with AITER+V1 (#19822)
qli88 committed over 1 year ago
[Chore]: qwen3-moe-type-hints-mistake (#19860)
Xerxes committed over 1 year ago
[Benchmark] Fix `Value of type "SampleRequest" is not indexable` (#18032)
Brayden Zhong committed over 1 year ago
[CI][Neuron] Fail and exit on first error (#19622)
Elaine Zhao committed over 1 year ago
[CI/Build][Bugfix] Fix deadlock on v1 engine test CI (#19872)
Isotr0py committed over 1 year ago
[Benchmark][Bugfix] Fix Dataset Length Calculation (#19868)
Robert Shaw committed over 1 year ago
[Frontend] early return chat format resolution when specified (#19735)
xzbdmw committed over 1 year ago
[Core][Bugfix] Fix Online MM Beam Search (#19688)
Alex Brooks committed over 1 year ago
[CI][CPU] Improve dummy Triton interfaces and fix the CPU CI (#19838)
Li, Jiang committed over 1 year ago
[Doc] Update V1 user guide for embedding models (#19842)
22quinn committed over 1 year ago
Fixing Chunked Prefill Test. (#19762)
Alexei-V-Ivanov-AMD committed over 1 year ago
[Frontend] Add optional token-level progress bar to `LLM.beam_search` (#19301)
NekoMimiUnagi committed over 1 year ago
Add xLAM tool parser support (#17148)
Zuxin committed over 1 year ago
[Minor] Allow redirecting model path for HfRunner in test (#19795)
Isotr0py committed over 1 year ago