A high-throughput and memory-efficient inference and serving engine for LLMs

main

[CI] Reuse ColQwen3 models across pooling tests (#55889)

Andreas Karatzas committed about 1 month ago

[CI] Split long misc test groups by command (#52346)

Kevin H. Luu committed about 1 month ago

[Bugfix] Handle null RoPE parameters for NoPE layers (#55949)

Andreas Karatzas committed about 1 month ago

[Bugfix] speedup nvfp4 kv for FMHA (#55031)

sychen52 committed about 1 month ago

[Refactor] Remove utils dead code (#53941)

Wentao Ye committed about 2 months ago

[Core] Scope PCP-DP validation to GPU manager (#54523)

Qiu Chunshuo committed about 2 months ago

[LoRA] Clarify target module matching logic (#55865)

linitra24 committed about 2 months ago

[4/N][warmup][DSv4] Migrate common attention kernels (#50176)

Roberto L. Castro committed about 2 months ago

[Model] Enable torch.compile for Sarvam MLA (#55817)

Mohit Singla committed about 2 months ago

← Newer Page 70 of 1120 Older →