xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-10 10:40:44 +08:00
Code Issues Packages Projects Releases Wiki Activity
vllm/csrc/quantization/gguf
History
Isotr0py 360bd67cf0
[Core] Support loading GGUF model (#5191) 
Co-authored-by: Michael Goin <michael@neuralmagic.com>
2024-08-05 17:54:23 -06:00
..
dequantize.cuh
[Core] Support loading GGUF model (#5191)
2024-08-05 17:54:23 -06:00
ggml-common.h
[Core] Support loading GGUF model (#5191)
2024-08-05 17:54:23 -06:00
gguf_kernel.cu
[Core] Support loading GGUF model (#5191)
2024-08-05 17:54:23 -06:00
mmq.cuh
[Core] Support loading GGUF model (#5191)
2024-08-05 17:54:23 -06:00
mmvq.cuh
[Core] Support loading GGUF model (#5191)
2024-08-05 17:54:23 -06:00
vecdotq.cuh
[Core] Support loading GGUF model (#5191)
2024-08-05 17:54:23 -06:00