@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 05:30 UTC

main

Revert adding Megablocks (#2030)

Woosuk Kwon committed almost 3 years ago

Update requirements.txt for mixtral (#2029)

Ram committed almost 3 years ago

Update run_on_sky.rst (#2025)

Ikko Eltociear Ashimine committed almost 3 years ago

Change the load format to pt for Mixtral (#2028)

Woosuk Kwon committed almost 3 years ago

Minor fixes for Mixtral (#2015)

Woosuk Kwon committed almost 3 years ago

Mixtral 8x7B support (#2011)

Pierre Stock committed almost 3 years ago

Fix completion API echo and logprob combo (#1992)

Simon Mo committed almost 3 years ago

[Minor] Add comment on skipping rope caches (#2004)

Woosuk Kwon committed almost 3 years ago

[Minor] Fix code style for baichuan (#2003)

Woosuk Kwon committed almost 3 years ago

Fix for KeyError on Loading LLaMA (#1978)

Jun Gao committed almost 3 years ago

[Docker] Add cuda arch list as build option (#1950)

Simon Mo committed almost 3 years ago

Fix Baichuan2-7B-Chat (#1987)

firebook committed almost 3 years ago

fix typo in getenv call (#1972)

Daya Khudia committed almost 3 years ago

Fix quickstart.rst typo jinja (#1964)

gottlike committed almost 3 years ago

Fix typo in adding_model.rst (#1947)

Peter Götz committed almost 3 years ago

← Newer Page 1093 of 1120 Older →