Isotr0py e1464c3a08

[Quantization] Enable compressed-tensors AWQ for Turing GPU (#29732) ...

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

2025-11-30 06:04:28 +00:00

..

compressed_tensors

[Quantization] Enable compressed-tensors AWQ for Turing GPU (#29732)

2025-11-30 06:04:28 +00:00

kernels

[Kernel][Quantization] add w4a8 support for marlin kernel (#24722)

2025-11-29 07:19:33 -08:00

quark

[Doc]: fixing typos in various files. (#29717)

2025-11-29 01:15:39 -08:00

utils

[Kernel][Quantization] add w4a8 support for marlin kernel (#24722)

2025-11-29 07:19:33 -08:00

__init__.py

[CPU] Refactor CPU WNA16 (#28826)

2025-11-19 10:32:00 +08:00

auto_round.py

[Kernel][Quantization] add w4a8 support for marlin kernel (#24722)

2025-11-29 07:19:33 -08:00

awq_marlin.py

[Kernel][Quantization] add w4a8 support for marlin kernel (#24722)

2025-11-29 07:19:33 -08:00

awq_triton.py

…

awq.py

[Kernel][Quantization] add w4a8 support for marlin kernel (#24722)

2025-11-29 07:19:33 -08:00

base_config.py

…

bitblas.py

…

bitsandbytes.py

[MoE][Refactor] Make select_experts a non-static method (#29067)

2025-11-24 13:38:04 -05:00

cpu_wna16.py

[CPU] Refactor CPU WNA16 (#28826)

2025-11-19 10:32:00 +08:00

deepspeedfp.py

…

experts_int8.py

[MoE][Refactor] Make select_experts a non-static method (#29067)

2025-11-24 13:38:04 -05:00

fbgemm_fp8.py

…

fp8.py

[Kernel][Quantization] add w4a8 support for marlin kernel (#24722)

2025-11-29 07:19:33 -08:00

fp_quant.py

…

gguf.py

[MoE][Refactor] Make select_experts a non-static method (#29067)

2025-11-24 13:38:04 -05:00

gptq_bitblas.py

…

gptq_marlin_24.py

…

gptq_marlin.py

[Kernel][Quantization] add w4a8 support for marlin kernel (#24722)

2025-11-29 07:19:33 -08:00

gptq.py

[Kernel] Add GPTQv2 format support for low-bit or asymmetric quantization, by adapting gptq_gemm (#26092)

2025-10-23 23:26:13 -04:00

hqq_marlin.py

[Kernel][Quantization] add w4a8 support for marlin kernel (#24722)

2025-11-29 07:19:33 -08:00

inc.py

…

input_quant_fp8.py

…

ipex_quant.py

[CPU] Refactor CPU WNA16 (#28826)

2025-11-19 10:32:00 +08:00

kv_cache.py

…

modelopt.py

[Kernel][Quantization] add w4a8 support for marlin kernel (#24722)

2025-11-29 07:19:33 -08:00

moe_wna16.py

[MoE][Refactor] Make select_experts a non-static method (#29067)

2025-11-24 13:38:04 -05:00

mxfp4.py

[LoRA] Support FusedMoE LoRA Triton kernel for mxfp4 (#29708)

2025-11-30 10:37:25 +08:00

petit.py

[Attention] Update attention imports (#29540)

2025-11-27 11:19:09 -05:00

ptpc_fp8.py

[Attention] Update attention imports (#29540)

2025-11-27 11:19:09 -05:00

qutlass_utils.py

…

rtn.py

[MoE][Refactor] Make select_experts a non-static method (#29067)

2025-11-24 13:38:04 -05:00

schema.py

…

torchao.py

Support using Int4PreshuffledTensor after loading (#26066)

2025-11-04 06:00:57 -05:00

tpu_int8.py

…