@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 03:15 UTC

main

[Platform] Move model arch check to platform (#11503)

Mengqing Cao committed almost 2 years ago

[BugFix] Fix quantization for all other methods (#11547)

Robert Shaw committed almost 2 years ago

[misc] fix typing (#11540)

youkaichao committed almost 2 years ago

[CI] Fix broken CI (#11543)

Robert Shaw committed almost 2 years ago

[V1] Fix yapf (#11538)

Woosuk Kwon committed almost 2 years ago

Update openai_compatible_server.md (#11536)

Robert Shaw committed almost 2 years ago

[Docs] Document Deepseek V3 support (#11535)

Simon Mo committed almost 2 years ago

Deepseek v3 (#11502)

Simon Mo committed almost 2 years ago

[2/N] API Server: Avoid ulimit footgun (#11530)

Robert Shaw committed almost 2 years ago

[1/N] API Server (Remove Proxy) (#11529)

Robert Shaw committed almost 2 years ago

[Misc] Add placeholder module (#11501)

Cyrus Leung committed almost 2 years ago

[Model] Modify MolmoForCausalLM MLP (#11510)

Jee Jee Li committed almost 2 years ago

[Misc][LoRA] Fix LoRA weight mapper (#11495)

Jee Jee Li committed almost 2 years ago

Mypy checking for vllm/compilation (#11496)

Lucas Tucker committed almost 2 years ago

← Newer Page 924 of 1120 Older →