Tyler Michael Smith aa2cd2c43d

[Bugfix] Disable w16a16 2of4 sparse CompressedTensors24 (#12417) ...

Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: mgoin <michael@neuralmagic.com>

2025-01-26 19:59:58 +08:00

..

__init__.py

…

test_bitsandbytes.py

[Bugfix] bitsandbytes models fail to run pipeline parallel (#10200)

2024-11-13 09:56:39 -07:00

test_compressed_tensors.py

[Bugfix] Disable w16a16 2of4 sparse CompressedTensors24 (#12417)

2025-01-26 19:59:58 +08:00

test_configs.py

…

test_cpu_offload.py

…

test_experts_int8.py

…

test_fp8.py

[Core] Interface for accessing model from VllmRunner (#10353)

2025-01-20 15:00:59 +08:00

test_ipex_quant.py

[Hardware][XPU] AWQ/GPTQ support for xpu backend (#10107)

2024-11-18 11:18:05 -07:00

test_lm_head.py

[Core] Interface for accessing model from VllmRunner (#10353)

2025-01-20 15:00:59 +08:00

test_quark.py

[Core] Interface for accessing model from VllmRunner (#10353)

2025-01-20 15:00:59 +08:00

test_register_quantization_config.py

[Misc] Support register quantization method out-of-tree (#11969)

2025-01-18 16:13:16 -08:00

utils.py

[torch.compile] limit inductor threads and lazy import quant (#10482)

2024-11-20 18:36:33 -08:00