xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2026-09-09 14:57:06 +08:00
Code Issues Packages Projects Releases Wiki Activity

[BugFix] Workspace allocation during profile run : DeepEPHighThroughput + DeepGEMM (#30899)

Browse Source 
(cherry picked from commit e3fc374a9a69dddb16885d810f1e28d3fdd39ebd)
This commit is contained in:
Varun Sundar Rabindranath 2025-12-17 18:00:59 -05:00 committed by Kevin H. Luu
parent 682c38583c
commit 17f3988094
1 changed files with 4 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
vllm/model_executor/layers/fused_moe/modular_kernel.py
View File

@ -795,7 +795,10 @@ class FusedMoEModularKernel(torch.nn.Module):
top_k, top_k,
global_num_experts, global_num_experts,
local_num_experts, local_num_experts,
expert_tokens_meta, # expert_tokens_meta help in allocating optimal/minimal
# amount of workspace. Mark it None, so we allocate for
# the worst-case scenario.
expert_tokens_meta=None,
) )
) )