@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 14, 05:30 UTC

main

[Docs] Fix typos in EP deployment doc (#24669)

Harry Mellor committed about 1 year ago

[Doc] Fix Markdown Pre-commit Error (#24670)

Wentao Ye committed about 1 year ago

[Docs] Add transcription support to model (#24664)

Nicolò Lucchesi committed about 1 year ago

Allow users to specify kv cache memory size (#21489)

Boyuan Feng committed about 1 year ago

[Bench] Add qwen-next in benchmark_moe.py (#24661)

Jee Jee Li committed about 1 year ago

Fix typing for `safetensors_load_strategy` (#24641)

Harry Mellor committed about 1 year ago

[Misc] Add @NickLucche to codeowners (#24647)

Nicolò Lucchesi committed about 1 year ago

[CI] Split pooling from entrypoints Test (#24632)

wang.yuqi committed about 1 year ago

[Bugfix] Fix _synced_weight_loader (#24565)

Kyuyeun Kim committed about 1 year ago

← Newer Page 652 of 1120 Older →