@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 14, 05:30 UTC

main

Update GLM-4.5 Doc transformers version (#25830)

Yuxuan Zhang committed about 1 year ago

[Bugfix][NIXL] Fix Async Scheduler timeout issue (#25808)

Nicolò Lucchesi committed about 1 year ago

[Core] GC Debug callback (#24829)

Jialin Ouyang committed about 1 year ago

[Bugfix] Fix triton import precommit failure (#25803)

Tyler Michael Smith committed about 1 year ago

Add filtering for chat template kwargs (#25794)

Russell Bryant committed about 1 year ago

Validate API tokens in constant time (#25781)

Russell Bryant committed about 1 year ago

← Newer Page 622 of 1120 Older →