5 Commits

Author	SHA1	Message	Date
Isotr0py	230b131b54	[Bugfix][kernels] Fix half2float conversion in gguf kernels (#15995) ... Signed-off-by: Isotr0py <2037008807@qq.com>	2025-04-04 09:38:58 -07:00
LukasBluebaum	90969fb39a	[Kernel] Add more dtype support for GGUF dequantization (#15879) ... Signed-off-by: lukas.bluebaum <lukas.bluebaum@aleph-alpha.com>	2025-04-02 01:58:48 -07:00
kliuae	7c25fe45a6	[AMD] Add support for GGUF quantization on ROCm (#10254)	2024-11-22 21:14:49 -08:00
Isotr0py	fc990f9795	[Bugfix][Kernel] Add IQ1_M quantization implementation to GGUF kernel (#8357)	2024-09-15 16:51:44 -06:00
Isotr0py	360bd67cf0	[Core] Support loading GGUF model (#5191) ... Co-authored-by: Michael Goin <michael@neuralmagic.com>	2024-08-05 17:54:23 -06:00