@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only / commits / e497f33491
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 00:45 UTC

[Core] Silence unnecessary deprecation warnings (#12620)

I noticed during testing that I was getting a lot of these deprecation warnings about `local_lora_path`: ``` DeprecationWarning: The 'lora_local_path' attribute is deprecated and will be removed in a future version. Please use 'lora_path' instead. ``` The check used for emitting this warning was always True, even when the parameter was not actually specified. It will always be in `__struct_fields__`. We should be checking for a non-None value, instead. Signed-off-by: Russell Bryant <rbryant@redhat.com> Signed-off-by: Russell Bryant <rbryant@redhat.com>

Russell Bryant committed Feb 2, 2025 at 02:35 UTC e497f33491671abbf94a3e563d55ca2818ee09db
1 file changed +1 -1
vllm/lora/request.py
+1 -1
@@ -31,7 +31,7 @@ class LoRARequest(
31 base_model_name: Optional[str] = msgspec.field(default=None)
32
33 def __post_init__(self):
34 - if 'lora_local_path' in self.__struct_fields__:
34 + if self.lora_local_path:
35 warnings.warn(
36 "The 'lora_local_path' attribute is deprecated "
37 "and will be removed in a future version. "