Michael Goin 873edda6cf

[Misc] Support FP8 MoE for compressed-tensors (#8588)

2024-09-25 09:43:36 -07:00

..

models-large.txt

[Misc] Support FP8 MoE for compressed-tensors (#8588)

2024-09-25 09:43:36 -07:00

models.txt

[Misc] Fused MoE Marlin support for GPTQ (#8217)

2024-09-09 23:02:52 -04:00

run_model_weight_loading_test.sh

[Kernel] Enable 8-bit weights in Fused Marlin MoE (#8032)

2024-09-16 09:47:19 -06:00

test_weight_loading.py

[Misc] Update GPTQ to use vLLMParameters (#7976)

2024-09-03 17:21:44 -04:00