@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 04:30 UTC

main

[torch.compile] allow tracking forward time (#11081)

youkaichao committed almost 2 years ago

Enable mypy checking on V1 code (#11105)

Mark McLoughlin committed almost 2 years ago

[V1][Bugfix] Fix V1 TP trust-remote-code (#11182)

Tyler Michael Smith committed almost 2 years ago

[V1][Bugfix] Fix EngineCoreProc profile (#11185)

Tyler Michael Smith committed almost 2 years ago

[Core] V1: Use multiprocessing by default (#11074)

Russell Bryant committed almost 2 years ago

[Doc] Reorganize online pooling APIs (#11172)

Cyrus Leung committed almost 2 years ago

[Misc] Add tokenizer_mode param to benchmark_serving.py (#11174)

Alexander Matveev committed almost 2 years ago

[Refactor]A simple device-related refactor (#11163)

Chenguang Li committed almost 2 years ago

← Newer Page 930 of 1120 Older →