@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 05:30 UTC

main

[Docs] Add "About" Heading to README.md (#2260)

blueceiling committed almost 3 years ago

[BugFix] Fix recovery logic for sequence group (#2186)

Woosuk Kwon committed almost 3 years ago

Disable Ray usage stats collection (#2206)

Woosuk Kwon committed almost 3 years ago

[Docs] Fix broken links (#2222)

Ronen Schaffer committed almost 3 years ago

Remove Sampler copy stream (#2209)

Antoni Baum committed almost 3 years ago

[BugFix] Fix weight loading for Mixtral with TP (#2208)

Woosuk Kwon committed almost 3 years ago

Added DeciLM-7b and DeciLM-7b-instruct (#2062)

avideci committed almost 3 years ago

Add warning on CUDA graph memory usage (#2182)

Woosuk Kwon committed almost 3 years ago

[ROCm] Fixes for GPTQ on ROCm (#2180)

kliuae committed almost 3 years ago

[Minor] Fix typo (#2166)

JohnSaxon committed almost 3 years ago

Add SSL arguments to API servers (#2109)

Harry Mellor committed almost 3 years ago

[BugFix] Fix RoPE kernel on long sequences(#2164)

Woosuk Kwon committed almost 3 years ago

Bump up to v0.2.6 (#2157)

Woosuk Kwon committed almost 3 years ago

Disable CUDA graph for SqueezeLLM (#2161)

Woosuk Kwon committed almost 3 years ago

← Newer Page 1090 of 1120 Older →