Robert Shaw 9b0c4bab36

[Kernel] Triton Configs for Fp8 Block Quantization (#11589) ...

Signed-off-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Signed-off-by: mgoin <michael@neuralmagic.com>
Co-authored-by: mgoin <michael@neuralmagic.com>
Co-authored-by: simon-mo <xmo@berkeley.edu>

2025-01-30 11:53:22 -08:00

..

compressed_tensors

[Bugfix] Disable w16a16 2of4 sparse CompressedTensors24 (#12417)

2025-01-26 19:59:58 +08:00

kernels

Update pre-commit hooks (#12475)

2025-01-27 17:23:08 -07:00

quark

[BugFix] Fix parameter names and process_after_weight_loading for W4A16 MoE Group Act Order (#11528)

2025-01-23 21:40:33 +00:00

utils

[Kernel] Triton Configs for Fp8 Block Quantization (#11589)

2025-01-30 11:53:22 -08:00

__init__.py

[Kernel] add triton fused moe kernel for gptq/awq (#12185)

2025-01-29 09:07:09 -05:00

aqlm.py

Remove ScaledActivation for AWQ (#10057)

2024-11-06 14:27:06 +00:00

awq_marlin.py

[BugFix] Fix parameter names and process_after_weight_loading for W4A16 MoE Group Act Order (#11528)

2025-01-23 21:40:33 +00:00

awq_triton.py

[Kernel] Explicitly specify other value in tl.load calls (#9014)

2024-11-18 11:39:40 -08:00

awq.py

Remove ScaledActivation for AWQ (#10057)

2024-11-06 14:27:06 +00:00

base_config.py

[Misc][Quark] Upstream Quark format to VLLM (#10765)

2025-01-15 11:05:15 -05:00

bitsandbytes.py

[[Misc]Upgrade bitsandbytes to the latest version 0.45.0 (#11201)

2024-12-15 03:03:06 +00:00

deepspeedfp.py

Remove ScaledActivation for AWQ (#10057)

2024-11-06 14:27:06 +00:00

experts_int8.py

[BugFix] Fix parameter names and process_after_weight_loading for W4A16 MoE Group Act Order (#11528)

2025-01-23 21:40:33 +00:00

fbgemm_fp8.py

Remove ScaledActivation for AWQ (#10057)

2024-11-06 14:27:06 +00:00

fp8.py

[BugFix] Fix parameter names and process_after_weight_loading for W4A16 MoE Group Act Order (#11528)

2025-01-23 21:40:33 +00:00

gguf.py

[Bugfix] Fix GGUF inference with FP16 unquantized checkpoint (#10675)

2024-11-27 10:43:17 -08:00

gptq_marlin_24.py

Remove ScaledActivation for AWQ (#10057)

2024-11-06 14:27:06 +00:00

gptq_marlin.py

[BugFix] Fix parameter names and process_after_weight_loading for W4A16 MoE Group Act Order (#11528)

2025-01-23 21:40:33 +00:00

gptq.py

[Hardware][XPU] AWQ/GPTQ support for xpu backend (#10107)

2024-11-18 11:18:05 -07:00

hqq_marlin.py

[Model][Quantization] HQQ support through Marlin kernel expansion (#9766)

2024-11-19 13:31:12 -08:00

ipex_quant.py

[Hardware][XPU] AWQ/GPTQ support for xpu backend (#10107)

2024-11-18 11:18:05 -07:00

kv_cache.py

[FP8][Kernel] Dynamic kv cache scaling factors computation (#11906)

2025-01-23 18:04:03 +00:00

marlin.py

Remove ScaledActivation for AWQ (#10057)

2024-11-06 14:27:06 +00:00

modelopt.py

Remove ScaledActivation for AWQ (#10057)

2024-11-06 14:27:06 +00:00

moe_wna16.py

[Kernel] add triton fused moe kernel for gptq/awq (#12185)

2025-01-29 09:07:09 -05:00

neuron_quant.py

Remove ScaledActivation for AWQ (#10057)

2024-11-06 14:27:06 +00:00

qqq.py

Remove ScaledActivation for AWQ (#10057)

2024-11-06 14:27:06 +00:00

schema.py

Enable scaled FP8 (e4m3fn) KV cache on ROCm (AMD GPU) (#3290)

2024-04-03 14:15:55 -07:00

tpu_int8.py

Remove ScaledActivation for AWQ (#10057)

2024-11-06 14:27:06 +00:00