shixianc 4c558cf62e

[Perf] Support topk softmax fused kernel for broader num_experts (#22211) ...

Signed-off-by: Shixian Cui <shixian@amazon.com>
Co-authored-by: Shixian Cui <shixian@amazon.com>

2025-08-12 21:34:47 -07:00

..

marlin_moe_wna16

remove unused variables in marlin_template.h (#20236)

2025-07-02 00:51:52 +00:00

permute_unpermute_kernels

Fix CUDA permute/unpermute for use with DeepGemm Moe (#17934)

2025-07-27 07:08:00 -07:00

moe_align_sum_kernels.cu

[perf] Speed up align sum kernels (#21079)

2025-07-21 11:19:23 -07:00

moe_ops.h

[Perf] Optimize moe_align_block_size CUDA kernel (#19572)

2025-06-17 11:49:26 -07:00

moe_permute_unpermute_op.cu

Fix CUDA permute/unpermute for use with DeepGemm Moe (#17934)

2025-07-27 07:08:00 -07:00

moe_wna16_utils.h

pre-commit autoupdate (#17380)

2025-04-29 06:46:55 -07:00

moe_wna16.cu

[BugFix] Accuracy fix for llama4 int4 - improperly casted scales (#16801)

2025-04-17 22:13:29 -07:00

topk_softmax_kernels.cu

[Perf] Support topk softmax fused kernel for broader num_experts (#22211)

2025-08-12 21:34:47 -07:00

torch_bindings.cpp

Fix CUDA permute/unpermute for use with DeepGemm Moe (#17934)

2025-07-27 07:08:00 -07:00