@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 14, 05:30 UTC

main

[Doc]: fix typos in Python comments (#24026)

Didier Durand committed about 1 year ago

[Kernel] Update DeepGEMM to latest commit (#23915)

Jee Jee Li committed about 1 year ago

[Misc] add hash_function doc string (#24014)

Ning Xie committed about 1 year ago

[Misc] IO Processor plugins for pooling models (#22820)

Christian Pinto committed about 1 year ago

Migrate Phi4 inputs to TensorSchema (#23471)

Benji Beck committed about 1 year ago

v1: Support KV events from connectors (#19737)

Or Ozeri committed about 1 year ago

[Minor] Fix some random typos in comments (#24009)

Nick Hill committed about 1 year ago

vllm fix check on max vocab size (#22471)

Xiaodong Wang committed about 1 year ago

[Doc]: fix typos in Python comments (#24001)

Didier Durand committed about 1 year ago

Fix wrong truncate_prompt_tokens type hint (#22761)

Gabriel Marinho committed about 1 year ago

← Newer Page 667 of 1120 Older →