xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2026-09-09 03:57:00 +08:00
Code Issues Packages Projects Releases Wiki Activity

[XPU][Triton]add xpu config in triton_reshape_and_cache_flash (#25643)

Browse Source 
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
This commit is contained in:
Kunshang Ji 2025-09-25 20:38:11 +08:00 committed by yewentao256
parent 222411313d
commit d7f6489f50
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
vllm/attention/ops/triton_reshape_and_cache_flash.py
View File

@ -137,7 +137,7 @@ def triton_reshape_and_cache_flash(
# heuristics instead of autotuning # heuristics instead of autotuning
TILE_SIZE = min(2048, triton.next_power_of_2(n)) TILE_SIZE = min(2048, triton.next_power_of_2(n))
if torch.version.hip: if torch.version.hip or torch.version.xpu:
num_stages = 4 num_stages = 4
num_warps = 8 num_warps = 8
else: # cuda else: # cuda