11 Commits

Author SHA1 Message Date
kijai
ce903c0384 Update mz_gguf_loader.py 2024-10-28 04:07:11 +02:00
kijai
195da244df make cfg 1.0 not do uncond, set steps by sigma schedule 2024-10-27 19:52:16 +02:00
kijai
4348d1ed20 fix Q4 cublas ops 2024-10-27 14:04:51 +02:00
kijai
e82e6ee3f7 Update mz_gguf_loader.py 2024-10-26 18:10:45 +03:00
kijai
c5c136cb11 fix 2024-10-26 17:57:02 +03:00
kijai
f29f739707 support cublas_ops with GGUF
pretty big speed boost on 4090 at least, needs this installed:
https://github.com/aredden/torch-cublas-hgemm
2024-10-26 16:42:25 +03:00
kijai
4c72322e8b Update mz_gguf_loader.py 2024-10-25 01:43:06 +03:00
kijai
8fad965c58 fix 2024-10-25 01:36:34 +03:00
kijai
a51ca0e907 Add GGUF_Q8_0 2024-10-25 01:28:09 +03:00
kijai
2c67025577 remove prints 2024-10-24 17:16:26 +03:00
kijai
f4c13b1ef4 Add first GGUF test version 2024-10-24 17:05:50 +03:00