chenqianfzh 4664ceaad6

support bitsandbytes 8-bit and FP4 quantized models (#7445)

2024-08-29 19:09:08 -04:00

..

__init__.py

…

test_bitsandbytes.py

support bitsandbytes 8-bit and FP4 quantized models (#7445)

2024-08-29 19:09:08 -04:00

test_compressed_tensors.py

…

test_configs.py

…

test_cpu_offload.py

…

test_experts_int8.py

…

test_fp8.py

…

test_lm_head.py

…

utils.py

…