xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2026-06-06 16:49:10 +08:00
Code Issues Packages Projects Releases Wiki Activity

Only register rocm_aiter_ops if aiter is found (#28428)

Browse Source 
Signed-off-by: mgoin <mgoin64@gmail.com>
This commit is contained in:
Michael Goin 2025-11-10 19:53:24 -07:00 committed by GitHub
parent de540c0354
commit f2d9ad0620
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 2 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
vllm/_aiter_ops.py
View File

@ -938,4 +938,5 @@ class rocm_aiter_ops:
return tuple(shuffle_weight(tensor, layout=layout) for tensor in tensors) return tuple(shuffle_weight(tensor, layout=layout) for tensor in tensors)
rocm_aiter_ops.register_ops_once() if IS_AITER_FOUND:
rocm_aiter_ops.register_ops_once()