xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-14 16:35:40 +08:00
Code Issues Packages Projects Releases Wiki Activity

[Doc] add backend to doc string of initialize_model_parallel (#22142)

Browse Source 
Signed-off-by: Andy Xie <andy.xning@gmail.com>
This commit is contained in:
Ning Xie 2025-08-05 10:36:20 +08:00 committed by GitHub
parent 7b455cf1c0
commit 29b97c0995
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
vllm/distributed/parallel_state.py
View File

@ -1013,6 +1013,7 @@ def initialize_model_parallel(
parallelism. parallelism.
pipeline_model_parallel_size: number of GPUs used for pipeline model pipeline_model_parallel_size: number of GPUs used for pipeline model
parallelism. parallelism.
backend: name of torch distributed communication backend.
Let's say we have a total of 8 GPUs denoted by g0 ... g7 and we Let's say we have a total of 8 GPUs denoted by g0 ... g7 and we
use 2 GPUs to parallelize the model tensor, and 4 GPUs to parallelize use 2 GPUs to parallelize the model tensor, and 4 GPUs to parallelize