rasmith e5697d161c

[Kernel] [Triton] [AMD] Adding Triton implementations awq_dequantize and awq_gemm to support AWQ (#7386)

2024-08-28 15:37:47 -04:00

..

compressed_tensors

[Kernel] Expand MoE weight loading + Add Fused Marlin MoE Kernel (#7766)

2024-08-27 15:07:09 -07:00

utils

[Kernel] (1/N) Machete - Hopper Optimized Mixed Precision Linear Kernel (#7174)

2024-08-20 07:09:33 -06:00

__init__.py

[Kernel] W8A16 Int8 inside FusedMoE (#7415)

2024-08-16 10:06:51 -07:00

aqlm.py

[Kernel] fix types used in aqlm and ggml kernels to support dynamo (#7596)

2024-08-16 14:00:11 -07:00

awq_marlin.py

[Misc] Update awq and awq_marlin to use vLLMParameters (#7422)

2024-08-13 17:08:20 -04:00

awq_triton.py

[Kernel] [Triton] [AMD] Adding Triton implementations awq_dequantize and awq_gemm to support AWQ (#7386)

2024-08-28 15:37:47 -04:00

awq.py

[Misc] Update awq and awq_marlin to use vLLMParameters (#7422)

2024-08-13 17:08:20 -04:00

base_config.py

[Core] Support loading GGUF model (#5191)

2024-08-05 17:54:23 -06:00

bitsandbytes.py

[bitsandbytes]: support read bnb pre-quantized model (#5753)

2024-07-23 23:45:09 +00:00

deepspeedfp.py

[ Misc ] fbgemm checkpoints (#6559)

2024-07-20 09:36:57 -07:00

experts_int8.py

[Kernel] W8A16 Int8 inside FusedMoE (#7415)

2024-08-16 10:06:51 -07:00

fbgemm_fp8.py

[Misc] Pass cutlass_fp8_supported correctly in fbgemm_fp8 (#6871)

2024-07-28 11:13:49 -04:00

fp8.py

[Kernel] Expand MoE weight loading + Add Fused Marlin MoE Kernel (#7766)

2024-08-27 15:07:09 -07:00

gguf.py

[Core] Support tensor parallelism for GGUF quantization (#7520)

2024-08-19 17:30:14 -04:00

gptq_marlin_24.py

[Misc] Update gptq_marlin_24 to use vLLMParameters (#7762)

2024-08-26 17:44:54 -04:00

gptq_marlin.py

[Misc] Update gptq_marlin to use new vLLMParameters (#7281)

2024-08-13 14:30:11 -04:00

gptq.py

[Kernel] fix types used in aqlm and ggml kernels to support dynamo (#7596)

2024-08-16 14:00:11 -07:00

kv_cache.py

[Bugfix] Fix kv_cache_dtype=fp8 without scales for FP8 checkpoints (#6761)

2024-07-25 09:46:15 -07:00

marlin.py

[Misc] Update marlin to use vLLMParameters (#7803)

2024-08-23 14:30:52 -04:00

qqq.py

[Misc] Update qqq to use vLLMParameters (#7805)

2024-08-26 13:16:15 -06:00

schema.py

Enable scaled FP8 (e4m3fn) KV cache on ROCm (AMD GPU) (#3290)

2024-04-03 14:15:55 -07:00

squeezellm.py

[ Misc ] fbgemm checkpoints (#6559)

2024-07-20 09:36:57 -07:00

tpu_int8.py

[TPU] Add Load-time W8A16 quantization for TPU Backend (#7005)

2024-08-08 18:35:49 -07:00