@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 07:00 UTC

main

[7/N] torch.compile, reduce compilation time (#10460)

youkaichao committed almost 2 years ago

[perf bench] H200 development (#9768)

Simon Mo committed almost 2 years ago

[Platforms] Refactor xpu code (#10468)

Mengqing Cao committed almost 2 years ago

[model] Reduce medusa weight (#10454)

Sky Lee committed almost 2 years ago

[ci/build] Combine nightly and optional (#10465)

Kevin H. Luu committed almost 2 years ago

[CI/Build] Add sphinx/rst linter for docs (#10366)

Rafael Vasquez committed almost 2 years ago

[Misc] Add __setitem__ for LazyDict (#10469)

Yanyi Liu committed almost 2 years ago

[Bugfix] Marlin 2:4 temp fix for large M dim (>256) (#10464)

Lucas Wilkinson committed almost 2 years ago

[CI/Build] Update Dockerfile.rocm (#10434)

Alexei-V-Ivanov-AMD committed almost 2 years ago

[Core] Avoid metrics log noise when idle (#8868)

Russell Bryant committed almost 2 years ago

[6/N] torch.compile rollout to users (#10437)

youkaichao committed almost 2 years ago

← Newer Page 945 of 1120 Older →