diff --git a/docs/source/serving/deploying_with_docker.rst b/docs/source/serving/deploying_with_docker.rst index 4d6c18512b045..58fadc2525f21 100644 --- a/docs/source/serving/deploying_with_docker.rst +++ b/docs/source/serving/deploying_with_docker.rst @@ -7,7 +7,7 @@ vLLM offers official docker image for deployment. The image can be used to run OpenAI compatible server. The image is available on Docker Hub as `vllm/vllm-openai `_. -... code-block:: console +.. code-block:: console $ docker run --runtime nvidia --gpus all \ -v ~/.cache/huggingface:/root/.cache/huggingface \