A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 16, 17:00 UTC
Remove faulty Meta-Llama-3-8B-Instruct-FP8.yaml lm-eval test (#7961)
Michael Goin committed
Aug 28, 2024 at 19:19 UTC
af59df0a108eb1f00d471c7fd2b70ce957095470
1 file changed
-1
.buildkite/lm-eval-harness/configs/models-small.txt
-1
@@ -1,5 +1,4 @@
1
Meta-Llama-3-8B-Instruct.yaml
2
-Meta-Llama-3-8B-Instruct-FP8.yaml
2
Meta-Llama-3-8B-Instruct-FP8-compressed-tensors.yaml
3
Meta-Llama-3-8B-Instruct-INT8-compressed-tensors.yaml
4
Meta-Llama-3-8B-Instruct-nonuniform-compressed-tensors.yaml