xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2026-01-23 20:24:34 +08:00
Code Issues Packages Projects Releases Wiki Activity

[Doc] Fixed shape description for fused_batched_moe.py (#25668)

Browse Source 
Signed-off-by: Egor <e.a.krivov@gmail.com>
This commit is contained in:
Egor 2025-10-03 13:00:23 +02:00 committed by GitHub
parent 79aa244678
commit aa5053e3fe
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
vllm/model_executor/layers/fused_moe/fused_batched_moe.py
View File

@ -355,7 +355,7 @@ def batched_triton_kernel(
def invoke_moe_batched_triton_kernel(
A: torch.Tensor, # [E, max_tokens, K]
B: torch.Tensor, # [E, K, N]
B: torch.Tensor, # [E, N, K]
C: torch.Tensor, # [E, max_tokens, N]
expert_num_tokens: torch.Tensor, # [E]
compute_type: tl.dtype,