@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 02:00 UTC

main

[platform] add device_control env var (#12009)

youkaichao committed almost 2 years ago

Fix Max Token ID for Qwen-VL-Chat (#11980)

Alex Brooks committed almost 2 years ago

[platform] add ray_device_key (#11948)

youkaichao committed almost 2 years ago

[Misc]Minor Changes about Worker (#11555)

Chenguang Li committed almost 2 years ago

[Misc] Fix Deepseek V2 fp8 kv-scale remapping (#11947)

Concurrensee committed almost 2 years ago

[MISC] fix typo in kv transfer send recv test (#11983)

Yangcheng Li committed almost 2 years ago

[V1][Core][1/n] Logging and Metrics (#11962)

Robert Shaw committed almost 2 years ago

[Hardware][TPU] workaround fix for MoE on TPU (#11764)

Avshalom Manevich committed almost 2 years ago

[CI/Build] Add markdown linter (#11857)

Rafael Vasquez committed almost 2 years ago

[V1] Avoid sending text prompt to core engine (#11963)

Roger Wang committed almost 2 years ago

← Newer Page 914 of 1120 Older →