@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 05:30 UTC

main

Add StableLM3B model (#2372)

Hyunsung Lee committed almost 3 years ago

ci: retry on build failure as well (#2457)

Simon Mo committed almost 3 years ago

fix weigit loading for GQA with TP (#2379)

Chenhui Zhang committed almost 3 years ago

Announce the second vLLM meetup (#2444)

Woosuk Kwon committed almost 3 years ago

[CI] Add Buildkite (#2355)

Simon Mo committed almost 3 years ago

[Minor] Fix err msg (#2431)

Woosuk Kwon committed almost 3 years ago

Aligning `top_p` and `top_k` Sampling (#1885)

陈序 committed almost 3 years ago

Update quickstart.rst (#2369)

Simon committed almost 3 years ago

Suggest using dtype=half when OOM.

Ben committed almost 3 years ago

Address Phi modeling update 2 (#2428)

Gary Hui committed almost 3 years ago

Allow setting fastapi root_path argument (#2341)

Chirag Jain committed almost 3 years ago

Add gradio chatbot for openai webserver (#2307)

arkohut committed almost 3 years ago

Rename phi_1_5 -> phi (#2385)

Woosuk Kwon committed almost 3 years ago

`get_ip()`: Fix ipv4 ipv6 dualstack (#2408)

Yunfeng Bai committed almost 3 years ago

← Newer Page 1088 of 1120 Older →