@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 01:45 UTC

main

[CI] clean docker cache for neuron (#4441)

Simon Mo committed over 2 years ago

Add more Prometheus metrics (#2764)

Ronen Schaffer committed over 2 years ago

[Model] Phi-3 4k sliding window temp. fix (#4380)

Caio Mendes committed over 2 years ago

[Kernel] Full Tensor Parallelism for LoRA Layers (#3524)

Austin Veselka committed over 2 years ago

[Misc] Fix logger format typo (#4396)

Roy committed over 2 years ago

[Misc] add RFC issue template (#4401)

youkaichao committed over 2 years ago

← Newer Page 1060 of 1120 Older →