vllm/docs/configuration

Configuration Options

This section lists the most common options for running vLLM.

There are three main levels of configuration, from highest priority to lowest priority:

• [Request parameters][completions-api] and [input arguments][sampling-params]
• Engine arguments
• Environment variables