@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 04:30 UTC

main

[Model] IBM Granite 3.1 (#11307)

Travis Johnson committed almost 2 years ago

[V1] VLM - enable processor cache by default (#11305)

Alexander Matveev committed almost 2 years ago

[Bugfix] fix minicpmv test (#11304)

Joe Runde committed almost 2 years ago

[FIX] update openai version (#11287)

Kunshang Ji committed almost 2 years ago

[MISC][XPU]update ipex link for CI fix (#11278)

Yan Ma committed almost 2 years ago

[Bugfix] Restore support for larger block sizes (#11259)

Konrad Zawora committed almost 2 years ago

[Misc] Kernel Benchmark for `RMSNorm` (#11241)

Roger Wang committed almost 2 years ago

[V1][Core] Use weakref.finalize instead of atexit (#11242)

Tyler Michael Smith committed almost 2 years ago

← Newer Page 928 of 1120 Older →