This website requires JavaScript.
Explore
Help
Sign In
xinyun
/
vllm
Watch
1
Star
0
Fork
0
You've already forked vllm
mirror of
https://git.datalinker.icu/vllm-project/vllm.git
synced
2025-12-10 13:44:58 +08:00
Code
Issues
Packages
Projects
Releases
Wiki
Activity
vllm
/
csrc
/
quantization
History
James Fleming
2b7949c1c2
AQLM CUDA support (
#3287
)
...
Co-authored-by: mgoin <michael@neuralmagic.com>
2024-04-23 13:59:33 -04:00
..
aqlm
AQLM CUDA support (
#3287
)
2024-04-23 13:59:33 -04:00
awq
Refactor 2 awq gemm kernels into m16nXk32 (
#2723
)
2024-02-12 11:02:17 -08:00
fp8
/amd_detail
Enable scaled FP8 (e4m3fn) KV cache on ROCm (AMD GPU) (
#3290
)
2024-04-03 14:15:55 -07:00
fp8_e5m2_kvcache
Fix compile error when using rocm (
#2648
)
2024-02-01 09:35:09 -08:00
gptq
[Core] Set
linear_weights
directly on the layer (
#3977
)
2024-04-11 16:35:51 -04:00
marlin
Integrate Marlin Kernels for Int4 GPTQ inference (
#2497
)
2024-03-01 12:47:51 -08:00
squeezellm
Enable CUDA graph for GPTQ & SqueezeLLM (
#2318
)
2024-01-03 09:52:29 -08:00
