@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 23:15 UTC

main

[Bugfix][TPU] Fix KV cache size calculation (#5860)

Woosuk Kwon committed over 2 years ago

[Bugfix] Fix embedding to support 2D inputs (#5829)

Woosuk Kwon committed over 2 years ago

[Bugfix] Fix assertion in NeuronExecutor (#5841)

aws-patlange committed over 2 years ago

[CI/Build] Add E2E tests for MLPSpeculator (#5791)

Thomas Parnell committed over 2 years ago

[Hardware][TPU] Refactor TPU backend (#5831)

Woosuk Kwon committed over 2 years ago

[Misc] Remove useless code in cpu_worker (#5824)

Jie Fu (傅杰) committed over 2 years ago

[ci] Remove aws template (#5757)

Kevin H. Luu committed over 2 years ago

← Newer Page 1035 of 1120 Older →