xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-13 20:25:01 +08:00
Code Issues Packages Projects Releases Wiki Activity

[Docs] Update installation instructions to include CUDA 11.8 xFormers (#2246)

Browse Source
This commit is contained in:
Shivam Thakkar 2023-12-23 12:50:02 +05:30 committed by GitHub
parent a1b9cb2a34
commit 1db83e31a2
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 4 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
docs/source/getting_started/installation.rst
View File

@ -42,6 +42,10 @@ You can install vLLM using pip:
$ pip uninstall torch -y $ pip uninstall torch -y
$ pip install torch --upgrade --index-url https://download.pytorch.org/whl/cu118 $ pip install torch --upgrade --index-url https://download.pytorch.org/whl/cu118
$ # Re-install xFormers with CUDA 11.8.
$ pip uninstall xformers -y
$ pip install --upgrade xformers --index-url https://download.pytorch.org/whl/cu118
.. _build_from_source: .. _build_from_source: