xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-14 17:26:02 +08:00
Code Issues Packages Projects Releases Wiki Activity

[Doc] add VLLM_TARGET_DEVICE=neuron to documentation for neuron (#6844)

Browse Source 
Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>
This commit is contained in:
omrishiv 2024-07-26 20:20:16 -07:00 committed by GitHub
parent ced36cd89b
commit 3c3012398e
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
docs/source/getting_started/neuron-installation.rst
View File

@ -131,6 +131,6 @@ Once neuronx-cc and transformers-neuronx packages are installed, we will be able
$ git clone https://github.com/vllm-project/vllm.git $ git clone https://github.com/vllm-project/vllm.git
$ cd vllm $ cd vllm
$ pip install -U -r requirements-neuron.txt $ pip install -U -r requirements-neuron.txt
$ pip install . $ VLLM_TARGET_DEVICE="neuron" pip install .
If neuron packages are detected correctly in the installation process, ``vllm-0.3.0+neuron212`` will be installed. If neuron packages are detected correctly in the installation process, ``vllm-0.3.0+neuron212`` will be installed.