@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 06:45 UTC

main

[FIX] Fix docker build error (#1831) (#1832)

Allen committed almost 3 years ago

Refactor Worker & InputMetadata (#1843)

Woosuk Kwon committed almost 3 years ago

Disable Logs Requests should Disable Logging of requests. (#1779)

Michael McCulloch committed almost 3 years ago

Refactor Attention (#1840)

Woosuk Kwon committed almost 3 years ago

Better integration with Ray Serve (#1821)

FlorianJoncour committed almost 3 years ago

[Fix] Fix RoPE in ChatGLM-32K (#1841)

Woosuk Kwon committed almost 3 years ago

[FIX] Fix formatting error in main branch (#1822)

Zhuohan Li committed almost 3 years ago

[FIX] Fix formatting error

Zhuohan Li committed almost 3 years ago

Use the type BlockTable (#1791)

explainerauthors committed almost 3 years ago

[FIX] Fix class naming (#1803)

Zhuohan Li committed almost 3 years ago

Fix OPT param names (#1819)

Woosuk Kwon committed almost 3 years ago

Correct comments in parallel_state.py (#1818)

explainerauthors committed almost 3 years ago

Added echo function to OpenAI API server. (#1504)

Yunmo Chen committed almost 3 years ago

Fix model docstrings (#1764)

Woosuk Kwon committed almost 3 years ago

[Build] Avoid building too many extensions (#1624)

Yanming W committed almost 3 years ago

← Newer Page 1095 of 1120 Older →