Amir Samani 28579b55fa add stream to cuda graph catpure ...

Signed-off-by: Amir Samani <asamani@nvidia.com>

2025-11-21 14:23:45 -08:00

..

deepgemm

…

bench_block_fp8_gemm.py

Remove weight_scale.T special case for SM90 Block FP8 CUTLASS kernel (#28431)

2025-11-11 11:46:04 -05:00

bench_fp8_gemm.py

…

bench_int8_gemm.py

…

bench_mxfp4_qutlass.py

…

bench_nvfp4_gemm.py

…

bench_nvfp4_qutlass.py

…

bench_per_token_quant_fp8.py

[Chore]:Extract math and argparse utilities to separate modules (#27188)

2025-10-26 04:03:32 -07:00

benchmark_activation.py

[Chore]:Extract math and argparse utilities to separate modules (#27188)

2025-10-26 04:03:32 -07:00

benchmark_bitblas.py

[Chore]:Extract math and argparse utilities to separate modules (#27188)

2025-10-26 04:03:32 -07:00

benchmark_cutlass_fp4_moe.py

[Chore]:Extract math and argparse utilities to separate modules (#27188)

2025-10-26 04:03:32 -07:00

benchmark_cutlass_moe_fp8.py

Replace torch.cuda.Event with torch.Event for better hardware compatibility (#26985)

2025-11-18 11:34:36 -08:00

benchmark_device_communicators.py

add stream to cuda graph catpure

2025-11-21 14:23:45 -08:00

benchmark_fused_collective.py

[PERF] Allreduce fusion. Support torch native matching. Tuning of the thresholds (#24248)

2025-11-10 18:33:11 -05:00

benchmark_grouped_gemm_cutlass.py

Disable nm-testing models with issues in CI (#28206)

2025-11-06 06:19:07 -08:00

benchmark_layernorm.py

[Chore]:Extract math and argparse utilities to separate modules (#27188)

2025-10-26 04:03:32 -07:00

benchmark_lora.py

Load tuned fused_moe_lora shrink and expand kernel configs separately (#27435)

2025-11-04 18:27:35 +08:00

benchmark_machete.py

[Chore]:Extract math and argparse utilities to separate modules (#27188)

2025-10-26 04:03:32 -07:00

benchmark_marlin.py

[Chore]:Extract math and argparse utilities to separate modules (#27188)

2025-10-26 04:03:32 -07:00

benchmark_moe_align_block_size.py

…

benchmark_moe_permute_unpermute.py

Replace torch.cuda.Event with torch.Event for better hardware compatibility (#26985)

2025-11-18 11:34:36 -08:00

benchmark_moe.py

Replace torch.cuda.Event with torch.Event for better hardware compatibility (#26985)

2025-11-18 11:34:36 -08:00

benchmark_mrope.py

Update rope_scaling to rope_parameters in preparation for Transformers v5 (#28542)

2025-11-19 09:06:36 -08:00

benchmark_paged_attention.py

[Chore]:Extract math and argparse utilities to separate modules (#27188)

2025-10-26 04:03:32 -07:00

benchmark_per_token_group_quant.py

Replace torch.cuda.Event with torch.Event for better hardware compatibility (#26985)

2025-11-18 11:34:36 -08:00

benchmark_quant.py

[Chore]:Extract math and argparse utilities to separate modules (#27188)

2025-10-26 04:03:32 -07:00

benchmark_reshape_and_cache_flash.py

[Chore]:Extract math and argparse utilities to separate modules (#27188)

2025-10-26 04:03:32 -07:00

benchmark_reshape_and_cache.py

[Chore]:Extract math and argparse utilities to separate modules (#27188)

2025-10-26 04:03:32 -07:00

benchmark_rmsnorm.py

…

benchmark_rope.py

Fix rotary embedding benchmark script (#28323)

2025-11-10 21:57:12 -05:00

benchmark_shapes.py

Disable nm-testing models with issues in CI (#28206)

2025-11-06 06:19:07 -08:00

benchmark_silu_mul_fp8_quant.py

Replace torch.cuda.Event with torch.Event for better hardware compatibility (#26985)

2025-11-18 11:34:36 -08:00

benchmark_trtllm_decode_attention.py

Replace torch.cuda.Event with torch.Event for better hardware compatibility (#26985)

2025-11-18 11:34:36 -08:00

benchmark_trtllm_prefill_attention.py

Replace torch.cuda.Event with torch.Event for better hardware compatibility (#26985)

2025-11-18 11:34:36 -08:00

benchmark_w8a8_block_fp8.py

Replace torch.cuda.Event with torch.Event for better hardware compatibility (#26985)

2025-11-18 11:34:36 -08:00

graph_machete_bench.py

[Chore]:Extract math and argparse utilities to separate modules (#27188)

2025-10-26 04:03:32 -07:00

requirements.txt

…

utils.py

…

weight_shapes.py

…