main
md 9 lines 411 Bytes
Rendered Raw
1 # Configuration Options
2
3 This section lists the most common options for running vLLM.
4
5 There are three main levels of configuration, from highest priority to lowest priority:
6
7 - [Request parameters](../serving/online_serving/openai_compatible_server.md#completions-api) and [input arguments](../api/README.md#inference-parameters)
8 - [Engine arguments](./engine_args.md)
9 - [Environment variables](./env_vars.md)