@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 8, 17:45 UTC

main

Bump HF Hub client to get bug fix (#33984)

Harry Mellor committed 9 months ago

support view_from_cpu_tensor on XPU (#33868)

Xinyu Chen committed 9 months ago

Fix `main` pre-commit (#33975)

Harry Mellor committed 9 months ago

Onboard voyage-4-nano (#33720)

chengchengpei committed 9 months ago

[XPU][4/N] add mxfp4 moe model support (#33679)

Kunshang Ji committed 9 months ago

[Docs] Add reo analytics (#33957)

Simon Mo committed 9 months ago

[Feature] OTEL tracing during loading (#31162)

emricksini-h committed 9 months ago

← Newer Page 437 of 1120 Older →