@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 15, 23:30 UTC

main

[core][rlhf] add colocate example for RLHF (#12984)

youkaichao committed almost 2 years ago

[core] port pynvml into vllm codebase (#12963)

youkaichao committed almost 2 years ago

[V1] Cache `uses_mrope` in GPUModelRunner (#12969)

Woosuk Kwon committed almost 2 years ago

[RFC] [Mistral] FP8 format (#10130)

Patrick von Platen committed almost 2 years ago

[V1][Minor] Remove outdated comment (#12968)

Woosuk Kwon committed almost 2 years ago

[VLM] Merged multi-modal processor for GLM4V (#12449)

Jee Jee Li committed almost 2 years ago

[bugfix] fix early import of flash attention (#12959)

youkaichao committed almost 2 years ago

[CI/Build] Auto-fix Markdown files (#12941)

Cyrus Leung committed almost 2 years ago

[Misc] Add qwen2.5-vl BNB support (#12944)

Isotr0py committed almost 2 years ago

← Newer Page 895 of 1120 Older →