xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-17 00:36:10 +08:00
Code Issues Packages Projects Releases Wiki Activity
vllm/csrc/quantization/fused_kernels
History
Luka Govedič 30870b4f66
[torch.compile] Dynamic fp8 + rms_norm fusion (#10906) 
Signed-off-by: luka <luka@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
2024-12-13 03:19:23 +00:00
..
fused_layernorm_dynamic_per_token_quant.cu
[torch.compile] Dynamic fp8 + rms_norm fusion (#10906)
2024-12-13 03:19:23 +00:00
layernorm_utils.cuh
[torch.compile] Dynamic fp8 + rms_norm fusion (#10906)
2024-12-13 03:19:23 +00:00
quant_conversions.cuh
[torch.compile] Dynamic fp8 + rms_norm fusion (#10906)
2024-12-13 03:19:23 +00:00