A high-throughput and memory-efficient inference and serving engine for LLMs

main

[XPU][CI] fix hf runner (#52730)

Qiming Zhang committed 2 months ago

[XPU] upgrade requirements/test/xpu.txt (#52672)

Qiming Zhang committed 2 months ago

Revert DSv4 eager workspace reuse (#52836)

Woosuk Kwon committed 2 months ago

[Bugfix] Fix DeepSeek V4 mHC broadcast buffer for dummy load (#51368)

ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟 committed 2 months ago

[ROCm][CI] Gating more ROCm tests (#44969)

Andreas Karatzas committed 2 months ago

[ROCm][CI] Add AMD CI Pull-Request Commands (#52822)

Andreas Karatzas committed 2 months ago

[nv] add pcp support in dsv3.2 (#52046)

Summer Yang committed 2 months ago

[ROCM][CI] Attention test speedup (#52763)

stefankoncarevic committed 2 months ago

← Newer Page 114 of 1120 Older →