xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-10 00:06:06 +08:00
Code Issues Packages Projects Releases Wiki Activity
vllm/benchmarks/kernels
History
Wentao Ye b6efafd9e4
[Perf] Vectorize static / dynamic INT8 quant kernels (#19233) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
2025-06-12 06:51:41 -07:00
..
deepgemm
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
bench_fp8_gemm.py
[Bugfix] Fix EAGLE vocab embedding construction for Llama 70B (#19033)
2025-06-05 19:10:08 -07:00
bench_int8_gemm.py
[Perf] Vectorize static / dynamic INT8 quant kernels (#19233)
2025-06-12 06:51:41 -07:00
benchmark_aqlm.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
benchmark_bitblas.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
benchmark_cutlass_fp4_moe.py
[Hardware][NVIDIA] FP4 MoE kernel optimization (#19110)
2025-06-05 09:48:26 -07:00
benchmark_grouped_gemm_cutlass.py
[Kernel] Integrate CUTLASS MoE kernel with PPLX (#18762)
2025-06-06 18:26:11 -07:00
benchmark_layernorm.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
benchmark_lora.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
benchmark_machete.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
benchmark_marlin.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
benchmark_moe_permute_unpermute.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
benchmark_moe.py
[Bugfix] Fix benchmark_moe.py (#19016)
2025-06-09 18:04:36 -07:00
benchmark_paged_attention.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
benchmark_quant.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
benchmark_rmsnorm.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
benchmark_rope.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
benchmark_shapes.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
benchmark_w8a8_block_fp8.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
graph_machete_bench.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
requirements.txt
[Kernel] (2/N) Machete - Integrate into CompressedTensorsWNA16 and GPTQMarlin (#7701)
2024-09-23 13:46:26 -04:00
utils.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
weight_shapes.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00