@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 05:30 UTC

main

fix python 3.8 syntax (#2716)

Simon Mo committed almost 3 years ago

Fix compile error when using rocm (#2648)

zhaoyang-star committed almost 3 years ago

Add Internlm2 (#2666)

Fengzhe Zhou committed almost 3 years ago

Add unit test for Mixtral MoE layer (#2677)

Philipp Moritz committed almost 3 years ago

[Minor] Fix test_cache.py CI test failure (#2684)

Philipp Moritz committed almost 3 years ago

fix some bugs (#2689)

zspo committed almost 3 years ago

Bump up version to v0.3.0 (#2656)

Zhuohan Li committed almost 3 years ago

Add quantized mixtral support (#2673)

Woosuk Kwon committed almost 3 years ago

[Minor] Fix false warning when TP=1 (#2674)

Woosuk Kwon committed almost 3 years ago

[Minor] Fix a small typo (#2672)

Philipp Moritz committed almost 3 years ago

Add swap_blocks unit tests (#2616)

Vladimir committed almost 3 years ago

Fused MOE for Mixtral (#2542)

Philipp Moritz committed almost 3 years ago

DeepseekMoE support with Fused MoE kernel (#2453)

wangding zeng committed almost 3 years ago

ROCm: Allow setting compilation target (#2581)

Rasmus Larsen committed almost 3 years ago

No repeated IPC open (#2642)

Hanzhi Zhou committed almost 3 years ago

Fix error when tp > 1 (#2644)

zhaoyang-star committed almost 3 years ago

Support FP8-E5M2 KV Cache (#2279)

zhaoyang-star committed almost 3 years ago

← Newer Page 1085 of 1120 Older →