From a38524f338a100bb0f0121c3aa24e8c4a9160d51 Mon Sep 17 00:00:00 2001 From: milo157 <43028253+milo157@users.noreply.github.com> Date: Wed, 17 Jul 2024 13:22:53 -0400 Subject: [PATCH] [DOC] - Add docker image to Cerebrium Integration (#6510) --- docs/source/serving/deploying_with_cerebrium.rst | 3 +++ 1 file changed, 3 insertions(+) diff --git a/docs/source/serving/deploying_with_cerebrium.rst b/docs/source/serving/deploying_with_cerebrium.rst index ff0ac911108c..9585b6ef5cb3 100644 --- a/docs/source/serving/deploying_with_cerebrium.rst +++ b/docs/source/serving/deploying_with_cerebrium.rst @@ -28,6 +28,9 @@ Next, to install the required packages, add the following to your cerebrium.toml .. code-block:: toml + [cerebrium.deployment] + docker_base_image_url = "nvidia/cuda:12.1.1-runtime-ubuntu22.04" + [cerebrium.dependencies.pip] vllm = "latest"