5 Commits

Author	SHA1	Message	Date
Lucas Wilkinson	86e9c8df29	[Kernel] (2/N) Machete - Integrate into CompressedTensorsWNA16 and GPTQMarlin (#7701) ... Co-authored-by: mgoin <michael@neuralmagic.com> Co-authored-by: Divakar Verma <137818590+divakar-amd@users.noreply.github.com> Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>	2024-09-23 13:46:26 -04:00
Dipika Sikka	2188a60c7e	[Misc] Update GPTQ to use vLLMParameters (#7976)	2024-09-03 17:21:44 -04:00
Dipika Sikka	955b5191c9	[Misc] update fp8 to use vLLMParameter (#7437)	2024-08-22 08:36:18 -04:00
Dipika Sikka	fb377d7e74	[Misc] Update gptq_marlin to use new vLLMParameters (#7281)	2024-08-13 14:30:11 -04:00
Dipika Sikka	0f7052bc7e	[Misc] Refactor linear layer weight loading; introduce BasevLLMParameter and weight_loader_v2 (#5874)	2024-08-07 09:17:58 -07:00