@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 03:15 UTC

main

fix: [doc] fix typo (#11751)

Lancer committed almost 2 years ago

[Bugfix][V1] Fix test_kv_cache_utils.py (#11738)

Jee Jee Li committed almost 2 years ago

[Bugfix] Fix precision error in LLaVA-NeXT (#11735)

Cyrus Leung committed almost 2 years ago

[V1] Add kv cache utils tests. (#11513)

xcnick committed almost 2 years ago

Update bnb.md with example for OpenAI (#11718)

Alberto Ferrer committed almost 2 years ago

Update tool_calling.md (#11701)

Hust_YangXian committed almost 2 years ago

[V1] log GPU blocks num for MultiprocExecutor (#11656)

WangErXiao committed almost 2 years ago

[V1] Chore: cruft removal (#11724)

Robert Shaw committed almost 2 years ago

[Misc]Add BNB quantization for Qwen2VL (#11719)

Jee Jee Li committed almost 2 years ago

[V1] Improve TP>1 Error Handling + Stack Trace (#11721)

Robert Shaw committed almost 2 years ago

← Newer Page 920 of 1120 Older →