Tyler Michael Smith eb5741ad42

[Kernel][Quantization] Integrate block-quantized CUTLASS kernels for DeepSeekV3 (#12587) ...

Integrates the block-quantized kernels introduced in
https://github.com/vllm-project/vllm/pull/11868 for use in linear
layers.

Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>

2025-01-31 15:29:11 -08:00

..

c3x

[Kernel] Update cutlass_scaled_mm to support 2d group (blockwise) scaling (#11868)

2025-01-30 18:33:00 -08:00

Epilogues.md

[Kernel] Add per-tensor and per-token AZP epilogues (#5941)

2024-08-06 18:17:08 +00:00

scaled_mm_c2x_sm75_dispatch.cuh

[Kernel] Tuned int8 Cutlass Kernels for SM75 (T4) (#6996)

2024-07-31 14:40:32 -07:00

scaled_mm_c2x_sm80_dispatch.cuh

[Kernel] Tuned FP8 Kernels for Ada Lovelace (#6677)

2024-07-29 09:42:35 -06:00

scaled_mm_c2x_sm89_fp8_dispatch.cuh

[Kernel] Tuned int8 kernels for Ada Lovelace (#6848)

2024-07-29 20:24:58 -06:00

scaled_mm_c2x_sm89_int8_dispatch.cuh

[Kernel] Tuned int8 kernels for Ada Lovelace (#6848)

2024-07-29 20:24:58 -06:00

scaled_mm_c2x.cu

[MISC] Replace c10::optional with std::optional (#11730)

2025-01-05 10:20:34 +09:00

scaled_mm_c2x.cuh

[Kernel] Refactor Cutlass c3x (#10049)

2024-12-19 07:00:18 +00:00

scaled_mm_c3x.cu

[Kernel][Quantization] Integrate block-quantized CUTLASS kernels for DeepSeekV3 (#12587)

2025-01-31 15:29:11 -08:00

scaled_mm_entry.cu

[Kernel][Quantization] Integrate block-quantized CUTLASS kernels for DeepSeekV3 (#12587)

2025-01-31 15:29:11 -08:00