@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only / commits / af59df0a10
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 17:00 UTC

Remove faulty Meta-Llama-3-8B-Instruct-FP8.yaml lm-eval test (#7961)

Michael Goin committed Aug 28, 2024 at 19:19 UTC af59df0a108eb1f00d471c7fd2b70ce957095470
1 file changed -1
.buildkite/lm-eval-harness/configs/models-small.txt
-1
@@ -1,5 +1,4 @@
1 Meta-Llama-3-8B-Instruct.yaml
2 -Meta-Llama-3-8B-Instruct-FP8.yaml
2 Meta-Llama-3-8B-Instruct-FP8-compressed-tensors.yaml
3 Meta-Llama-3-8B-Instruct-INT8-compressed-tensors.yaml
4 Meta-Llama-3-8B-Instruct-nonuniform-compressed-tensors.yaml