@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only / commits / b2f775456e
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 04:30 UTC

[CI/Build] Enable prefix caching test for AMD (#11098)

Signed-off-by: Hissu Hyvarinen <hissu.hyvarinen@amd.com>

hissu-hyvarinen committed Dec 11, 2024 at 17:23 UTC b2f775456e4af7412308320a9c11e4dac3086205
1 file changed +1 -1
.buildkite/test-pipeline.yaml
+1 -1
@@ -201,7 +201,7 @@ steps:
201 - python3 offline_profile.py --model facebook/opt-125m
202
203 - label: Prefix Caching Test # 9min
204 - #mirror_hardwares: [amd]
204 + mirror_hardwares: [amd]
205 source_file_dependencies:
206 - vllm/
207 - tests/prefix_caching