xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-09 22:25:32 +08:00
Code Issues Packages Projects Releases Wiki Activity

[Misc] add vllm_config in __init__ (#19866)

Browse Source 
Signed-off-by: Andy Xie <andy.xning@gmail.com>
This commit is contained in:
Ning Xie 2025-06-22 11:10:46 +08:00 committed by GitHub
parent 3b1e4c6a23
commit 4c409cabc2
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
vllm/worker/worker_base.py
View File

@ -509,6 +509,7 @@ class WorkerWrapperBase:
""" """
self.rpc_rank = rpc_rank self.rpc_rank = rpc_rank
self.worker: Optional[WorkerBase] = None self.worker: Optional[WorkerBase] = None
self.vllm_config: Optional[VllmConfig] = None
# do not store this `vllm_config`, `init_worker` will set the final # do not store this `vllm_config`, `init_worker` will set the final
# one. TODO: investigate if we can remove this field in # one. TODO: investigate if we can remove this field in
# `WorkerWrapperBase`, `init_cached_hf_modules` should be # `WorkerWrapperBase`, `init_cached_hf_modules` should be