A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 17, 08:00 UTC
Add performance figures for dark mode (#160)
Woosuk Kwon committed
Jun 18, 2023 at 23:46 UTC
5822ede66ee834f406d475ce28a1d8f666458a48
12 files changed
assets/figures/perf_a100_n1.png
Binary files a/assets/figures/perf_a100_n1.png and /dev/null differ
assets/figures/perf_a100_n1_dark.png
Binary files /dev/null and b/assets/figures/perf_a100_n1_dark.png differ
assets/figures/perf_a100_n1_light.png
Binary files /dev/null and b/assets/figures/perf_a100_n1_light.png differ
assets/figures/perf_a100_n3.png
Binary files a/assets/figures/perf_a100_n3.png and /dev/null differ
assets/figures/perf_a100_n3_dark.png
Binary files /dev/null and b/assets/figures/perf_a100_n3_dark.png differ
assets/figures/perf_a100_n3_light.png
Binary files /dev/null and b/assets/figures/perf_a100_n3_light.png differ
assets/figures/perf_a10g_n1.png
Binary files a/assets/figures/perf_a10g_n1.png and /dev/null differ
assets/figures/perf_a10g_n1_dark.png
Binary files /dev/null and b/assets/figures/perf_a10g_n1_dark.png differ
assets/figures/perf_a10g_n1_light.png
Binary files /dev/null and b/assets/figures/perf_a10g_n1_light.png differ
assets/figures/perf_a10g_n3.png
Binary files a/assets/figures/perf_a10g_n3.png and /dev/null differ
assets/figures/perf_a10g_n3_dark.png
Binary files /dev/null and b/assets/figures/perf_a10g_n3_dark.png differ
assets/figures/perf_a10g_n3_light.png
Binary files /dev/null and b/assets/figures/perf_a10g_n3_light.png differ