xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2026-06-07 17:42:21 +08:00
Code Issues Packages Projects Releases Wiki Activity

[Bugfix][V1][P/D]Fix the issue of occasional garbled output for P2pNcclConnector (#20263)

Browse Source 
Signed-off-by: Abatom <abzhonghua@gmail.com>
This commit is contained in:
Zhonghua Deng 2025-07-01 07:45:14 +08:00 committed by GitHub
parent 97d9524fe9
commit ded1fb635b
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 5 additions and 4 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
vllm/distributed/kv_transfer/kv_connector/v1/p2p/p2p_nccl_engine.py
View File

@ -310,6 +310,7 @@ class P2pNcclEngine:
elif data["cmd"] == "PUT": elif data["cmd"] == "PUT":
tensor_id = data["tensor_id"] tensor_id = data["tensor_id"]
try: try:
with torch.cuda.stream(self.recv_stream):
tensor = torch.empty(data["shape"], tensor = torch.empty(data["shape"],
dtype=getattr( dtype=getattr(
torch, data["dtype"]), torch, data["dtype"]),