@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 08:00 UTC

main

Clean up code (#844)

wenjun93 committed about 3 years ago

Fix for breaking changes in xformers 0.0.21 (#834)

Woosuk Kwon committed about 3 years ago

Fix typo of Aquila in README.md (#836)

ldwang committed about 3 years ago

Implement approximate GELU kernels (#828)

Woosuk Kwon committed about 3 years ago

Add compute capability 8.9 to default targets (#829)

Woosuk Kwon committed about 3 years ago

Update Supported Model List (#825)

Zhuohan Li committed about 3 years ago

Add support for aquila (#663)

shunxing1234 committed about 3 years ago

Fix mqa is false case in gpt_bigcode (#806)

zhaoyang-star committed about 3 years ago

Fix typo in sampling_params.py (#788)

wangcx18 committed over 3 years ago

explicitly del state (#784)

Xinyu Yang committed over 3 years ago

Align with huggingface Top K sampling (#753)

Abraham-Xu committed over 3 years ago

Fix typo in tokenizer.py (#750)

Ikko Eltociear Ashimine committed over 3 years ago

Fix baichuan doc style (#748)

Uranus committed over 3 years ago

add internlm model (#528)

Jia Guoqing committed over 3 years ago

← Newer Page 1106 of 1120 Older →