xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2026-03-16 14:17:16 +08:00
Code Issues Packages Projects Releases Wiki Activity

Updates docs with correction about default cuda version

Browse Source 
Correct 12.1 --> 12.4
This commit is contained in:
Michael Goin 2025-01-07 17:29:07 -05:00 committed by GitHub
parent 973f5dc581
commit c1d1875ba3
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 3 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6
docs/source/getting_started/installation/gpu-cuda.md
View File

@ -2,7 +2,7 @@
# Installation for CUDA # Installation for CUDA
vLLM is a Python library that also contains pre-compiled C++ and CUDA (12.1) binaries. vLLM is a Python library that also contains pre-compiled C++ and CUDA (12.4) binaries.
## Requirements ## Requirements
@ -43,12 +43,12 @@ Therefore, it is recommended to install vLLM with a **fresh new** environment. I
You can install vLLM using either `pip` or `uv pip`: You can install vLLM using either `pip` or `uv pip`:
```console ```console
$ # Install vLLM with CUDA 12.1. $ # Install vLLM with CUDA 12.4.
$ pip install vllm # If you are using pip. $ pip install vllm # If you are using pip.
$ uv pip install vllm # If you are using uv. $ uv pip install vllm # If you are using uv.
``` ```
As of now, vLLM's binaries are compiled with CUDA 12.1 and public PyTorch release versions by default. We also provide vLLM binaries compiled with CUDA 11.8 and public PyTorch release versions: As of now, vLLM's binaries are compiled with CUDA 12.4 and public PyTorch release versions by default. We also provide vLLM binaries compiled with CUDA 11.8 and public PyTorch release versions:
```console ```console
$ # Install vLLM with CUDA 11.8. $ # Install vLLM with CUDA 11.8.