@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 4, 23:45 UTC

main

[DOC] Add fuse_minimax_qk_norm (#39782)

Jee Jee Li committed 7 months ago

[Bugfix] Fix k_proj's bias for GLM-ASR (#40160)

Rishapveer Singh committed 7 months ago

[CI] Speed up test_fused_marlin_moe (#40178)

Michael Goin committed 7 months ago

[XPU]fake impl for xpu fp8_gemm (#39984)

Xinyu Chen committed 7 months ago

[AMD][CI] Update DeepEP branch (#38396)

Ryan Rock committed 7 months ago

skip fp8e4b15 on xpu (#39957)

Xinyu Chen committed 7 months ago

← Newer Page 326 of 1120 Older →