@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 19:30 UTC

main

[Core] Comment out unused code in sampler (#7023)

Peng Guanwen committed over 2 years ago

Fix tracing.py (#7065)

Bongwon Jang committed over 2 years ago

[ci][distributed] try to fix pp test (#7054)

youkaichao committed over 2 years ago

[mypy] Speed up mypy checking (#7056)

Cyrus Leung committed over 2 years ago

[Performance] Optimize `get_seqs` (#7051)

Woosuk Kwon committed over 2 years ago

[CI/Build][Bugfix] Fix CUTLASS header-only line (#7034)

Tyler Michael Smith committed over 2 years ago

Update run-amd-test.sh (#7044)

omkar kakarparthi committed over 2 years ago

[Models] Support Qwen model with PP (#6974)

Murali Andoorveedu committed over 2 years ago

[CI/Build] Update PyTorch to 2.4.0 (#6951)

Sage Moore committed over 2 years ago

[Build/CI] Fixing Docker Hub quota issue. (#7043)

Alexei-V-Ivanov-AMD committed over 2 years ago

← Newer Page 1012 of 1120 Older →