@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 05:45 UTC

main

[Interleaved ATTN] Support for Mistral-8B (#10591)

Patrick von Platen committed almost 2 years ago

[Bugfix] Fix OpenVino/Neuron `driver_worker` init (#10779)

Nicolò Lucchesi committed almost 2 years ago

[Bugfix] Fix Idefics3 bug (#10778)

Jee Jee Li committed almost 2 years ago

[Misc] typo find in sampling_metadata.py (#10740)

wang.yuqi committed almost 2 years ago

[Model] Clean up MiniCPMV (#10751)

Cyrus Leung committed almost 2 years ago

[Model] Add Internlm2 LoRA support (#5064)

Isotr0py committed almost 2 years ago

[TPU] Update requirements-tpu (#10726)

Richard Liu committed almost 2 years ago

[Kernel] Update vllm-flash-attn version (#10736)

Woosuk Kwon committed almost 2 years ago

[V1] Do not allocate beyond the max_model_len (#10730)

Woosuk Kwon committed almost 2 years ago

[misc] upgrade filelock version (#10731)

youkaichao committed almost 2 years ago

← Newer Page 939 of 1120 Older →