xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2026-05-20 19:57:02 +08:00
Code Issues Packages Projects Releases Wiki Activity

[XPU][Triton]add xpu config in triton_reshape_and_cache_flash (#25643)

Browse Source 
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
This commit is contained in:
Kunshang Ji 2025-09-25 20:38:11 +08:00 committed by GitHub
parent 0bcc3a160d
commit d2af67441d
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
vllm/attention/ops/triton_reshape_and_cache_flash.py
View File

@ -137,7 +137,7 @@ def triton_reshape_and_cache_flash(
# heuristics instead of autotuning # heuristics instead of autotuning
TILE_SIZE = min(2048, triton.next_power_of_2(n)) TILE_SIZE = min(2048, triton.next_power_of_2(n))
if torch.version.hip: if torch.version.hip or torch.version.xpu:
num_stages = 4 num_stages = 4
num_warps = 8 num_warps = 8
else: # cuda else: # cuda