A high-throughput and memory-efficient inference and serving engine for LLMs
main
[Refactor] Remove unused rocm kernel `combine_topk_swa_indices_ragged` (#48158)
Wentao Ye committed 4 months ago
[Model] Migrate MistralLarge3ForCausalLM to AutoWeightsLoader (#48153)
FAN YUCHEN committed 4 months ago
[Bugfix][Spec Decode] Fix DFlash draft/target layer-count mismatch (#48113)
Nick Hill committed 4 months ago
[Misc] Remove dead code in ViT functionality test (#48220)
Isotr0py committed 4 months ago
[Rust Frontend] Add roundtrip fixtures for more chat parsers (#47883)
Reid committed 4 months ago
Deepstream video backend (#42424)
ViranjanPagar committed 4 months ago
[CI] Add TORCH_NIGHTLY=1 build mode (run full suite on torch nightly) (#47180)
Andrey Talman committed 4 months ago
[Model][CI/Build] Cosmos3: enable registry tests and register Cosmos3-Super (#48211)
Mingfei Guo committed 4 months ago
[Rust Frontend] Integrate MM video support (#47959)
Bugen Zhao committed 4 months ago
Add XPU nightly and release image publishing to DockerHub (#48126)
wenjun liu committed 4 months ago
[CI] Right-size test-area timeouts from nightly durations (#48186)
Kevin H. Luu committed 4 months ago
[XPU] Enable v1/sample tests on XPU CI (#44472)
Chaojun Zhang committed 4 months ago
[Perf] fuse more rmsnorm and all-reduce in qwen3.5 (#46998)
Jiangyun Zhu committed 4 months ago
[Feature][Parser] Support include_reasoning param for non-Harmony models (#44301)
alberto committed 4 months ago
[Core][KV events] Report prefix-cache-reused blocks in full report mode (#45261)
GongLei-HW committed 4 months ago
DCP supports hybrid attention (#40996)
Yan Xu committed 4 months ago
[kv_offload] Emit tier-owned BlockStored events from FS/OBJ secondary tiers (#47923)
Chang Guo committed 4 months ago
[CI/Build][AMD] Fix ROCm OOM in eagle_correctness_heavy by reserving CUDA graph memory (#47366)
peizhang56 committed 4 months ago
[bugfix] bge-m3-sparse-plugin mismatch requests (#48112)
Augusto Yao committed 4 months ago
[ROCm][CI] Move remaining engine/samplers AMD steps to mi325_1 (#48169)
peizhang56 committed 4 months ago