xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-13 14:05:01 +08:00
Code Issues Packages Projects Releases Wiki Activity

[DOC] - Add docker image to Cerebrium Integration (#6510)

Browse Source
This commit is contained in:
milo157 2024-07-17 13:22:53 -04:00 committed by GitHub
parent 2fa4623d9e
commit a38524f338
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 3 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
docs/source/serving/deploying_with_cerebrium.rst
View File

@ -28,6 +28,9 @@ Next, to install the required packages, add the following to your cerebrium.toml
.. code-block:: toml .. code-block:: toml
[cerebrium.deployment]
docker_base_image_url = "nvidia/cuda:12.1.1-runtime-ubuntu22.04"
[cerebrium.dependencies.pip] [cerebrium.dependencies.pip]
vllm = "latest" vllm = "latest"