A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 12, 19:45 UTC
main
[CI/Build] Make test_attention_selector.py run tests on correct platform (#29064)
rasmith committed 12 months ago
[CI/Build][AMD] Skip if flash_attn_varlen_func not available in test_aiter_flash_attn.py (#29043)
rasmith committed 12 months ago
[Bugfix] - Add Trace Headers to Beam Search Path (#29100)
Software Developer committed 12 months ago
[chore] Update annotate release scripts (#29077)
Kevin H. Luu committed 12 months ago
[KVConnector][Core] Support cross-layer KV blocks (#27743)
Or Ozeri committed 12 months ago
[BugFix][PD]: make example proxy usable with P2pNcclConnector (#26628)
Pan Li committed 12 months ago
Updating the mirror of test-amd.yaml as of 2025-11-18 (#29016)
Alexei-V-Ivanov-AMD committed 12 months ago
[Frontend] Optimize beam search loop by sorting and then splicing (#19347)
rookie committed 12 months ago
[BugFix] [FEAT] Enable fastsafetensors for ROCm platform (#28225)
TJian committed 12 months ago
[BugFix] Fix flash_attn import in `siglip2navit.py` (#29082)
Fanli Lin committed 12 months ago
[Bugfix] Fix spec decode memory regression after #28549 (#28819)
Zhewen Li committed 12 months ago
[RL] Add Pause and Resume Generation for Asynchronous RL Training (#28037)
Samit committed 12 months ago
[MODEL] Implement plamo3 (#28834)
Shinichi Hemmi committed 12 months ago
[BugFix] kv_offloading: Fix bug in loading of partial cpu blocks (#28951)
Or Ozeri committed 12 months ago
[ROCm] Add AMD GPU support on Deepseek v3.2 and SparseMLA (#26670)
Pleaplusone committed 12 months ago
Add truncate arg to yarn to match openai implementation of gpt-oss (#28244)
Anna Shors committed 12 months ago
[Chore] Update `xgrammar` version from 0.1.25 to 0.1.27 (#28221)
cjackal committed 12 months ago
[Misc] don't cache `CUTLASS_REVISION` var in CMakeLists.txt (#28518)
Jinzhen Lin committed 12 months ago
[BugFix] Fix Llama4 Pipeline Parallelism Assert Error (#28577)
Dezhan committed 12 months ago
[Bugfix][cache_kernels]: Fix OOB in cache_kernels.cu (#28760)
Vensen committed 12 months ago