| 1 | --- |
| 2 | toc_depth: 3 |
| 3 | --- |
| 4 | |
| 5 | # Engine Arguments |
| 6 | |
| 7 | Engine arguments control the behavior of the vLLM engine. |
| 8 | |
| 9 | - For [offline inference](../serving/offline_inference.md), they are part of the arguments to [LLM][vllm.LLM] class. |
| 10 | - For [online serving](../serving/online_serving/README.md), they are part of the arguments to `vllm serve`. |
| 11 | |
| 12 | The engine argument classes, [EngineArgs][vllm.engine.arg_utils.EngineArgs] and [AsyncEngineArgs][vllm.engine.arg_utils.AsyncEngineArgs], are a combination of the configuration classes defined in [vllm.config][]. Therefore, if you are interested in developer documentation, we recommend looking at these configuration classes as they are the source of truth for types, defaults and docstrings. |
| 13 | |
| 14 | --8<-- "gen:engine-args" |