2 Commits

Author SHA1 Message Date
kijai
f29f739707 support cublas_ops with GGUF
pretty big speed boost on 4090 at least, needs this installed:
https://github.com/aredden/torch-cublas-hgemm
2024-10-26 16:42:25 +03:00
kijai
b80cb4a691 initial commit 2024-10-23 15:34:22 +03:00