xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-18 07:05:02 +08:00
Code Issues Packages Projects Releases Wiki Activity

[Misc] Restrict deep_gemm's log output (#20827)

Browse Source 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
This commit is contained in:
Jee Jee Li 2025-07-12 11:50:42 +08:00 committed by GitHub
parent a8593237c0
commit 44d02f54db
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
vllm/model_executor/layers/fused_moe/deep_gemm_moe.py
View File

@ -43,7 +43,7 @@ def _valid_deep_gemm(hidden_states: torch.Tensor, w1: torch.Tensor,
aligned by `dg.get_m_alignment_for_contiguous_layout()`. aligned by `dg.get_m_alignment_for_contiguous_layout()`.
""" """
if not has_deep_gemm(): if not has_deep_gemm():
logger.debug("DeepGemm disabled: deep_gemm not available.") logger.debug_once("DeepGemm disabled: deep_gemm not available.")
return False return False
M = hidden_states.size(0) M = hidden_states.size(0)