A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 16, 04:30 UTC
[CI/Build] Enable prefix caching test for AMD (#11098)
Signed-off-by: Hissu Hyvarinen <hissu.hyvarinen@amd.com>
hissu-hyvarinen committed
Dec 11, 2024 at 17:23 UTC
b2f775456e4af7412308320a9c11e4dac3086205
1 file changed
+1
-1
.buildkite/test-pipeline.yaml
+1
-1
@@ -201,7 +201,7 @@ steps:
201
- python3 offline_profile.py --model facebook/opt-125m
202
203
- label: Prefix Caching Test # 9min
204
- #mirror_hardwares: [amd]
204
+ mirror_hardwares: [amd]
205
source_file_dependencies:
206
- vllm/
207
- tests/prefix_caching