vllm/docs/source/serving/engine_args.md

(engine-args)=

Engine Arguments

Engine arguments control the behavior of the vLLM engine.

• For offline inference, they are part of the arguments to LLM class.
• For online serving, they are part of the arguments to vllm serve.

For references to all arguments available from vllm serve see the serve args documentation.

Below, you can find an explanation of every engine argument:

.. argparse::
    :module: vllm.engine.arg_utils
    :func: _engine_args_parser
    :prog: vllm serve
    :nodefaultconst:
    :markdownhelp:

Async Engine Arguments

Additional arguments are available to the asynchronous engine which is used for online serving:

.. argparse::
    :module: vllm.engine.arg_utils
    :func: _async_engine_args_parser
    :prog: vllm serve
    :nodefaultconst:
    :markdownhelp: