A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 15, 08:30 UTC
[Doc] Fix codeblocks formatting in LoRA adapters documentation (#18907)
Signed-off-by: Zerohertz <ohg3417@gmail.com>
Hyogeun Oh (오효근) committed
May 29, 2025 at 23:38 UTC
6f2909405edbd39478891f71dc2bfcbcda8530fa
1 file changed
+3
-2
docs/features/lora.md
+3
-2
@@ -165,6 +165,7 @@ it will first look in the local directory for a directory `foobar`, and attempt
165
that adapter will then be available for normal use on the server.
166
167
Alternatively, follow these example steps to implement your own plugin:
168
+
169
1. Implement the LoRAResolver interface.
170
171
Example of a simple S3 LoRAResolver implementation:
@@ -198,9 +199,9 @@ Alternatively, follow these example steps to implement your own plugin:
199
return lora_request
200
```
201
201
-2. Register LoRAResolver plugin.
202
+2. Register `LoRAResolver` plugin.
203
203
- ```python
204
+ ```python
205
from vllm.lora.resolver import LoRAResolverRegistry
206
207
s3_resolver = S3LoRAResolver()