@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 19:30 UTC

main

Fixes typo in function name (#7275)

Rafael Vasquez committed over 2 years ago

[BUGFIX]: top_k is expected to be an integer. (#7227)

Atilla Akkuş committed over 2 years ago

[Core] Optimize evictor-v2 performance (#7193)

xiaobochen123 committed over 2 years ago

[Bugfix] add gguf dependency (#7198)

Katarzyna Papis committed over 2 years ago

[ BugFix ] Fix ZMQ when `VLLM_PORT` is set (#7205)

Robert Shaw committed over 2 years ago

[BugFix] Fix DeepSeek remote code (#7178)

Dipika Sikka committed over 2 years ago

[LoRA] Relax LoRA condition (#7146)

Jee Jee Li committed over 2 years ago

← Newer Page 1009 of 1120 Older →