Mor Zusman f0eecee610

[Bugfix] Fix dummy weight for fp8 (#4916) ...

Allow dummy load format for fp8,
torch.uniform_ doesn't support FP8 at the moment

Co-authored-by: Mor Zusman <morz@ai21.com>

2024-05-20 18:44:25 +00:00

..

__init__.py

[Misc] Enhance attention selector (#4751)

2024-05-13 10:47:25 -07:00

loader.py

[Bugfix][Model] Add base class for vision-language models (#4809)

2024-05-19 00:13:33 -07:00

neuron.py

[Typing] Mypy typing part 2 (#4043)

2024-04-17 17:28:43 -07:00

tensorizer.py

[Frontend] [Core] perf: Automatically detect vLLM-tensorized model, update tensorizer to version 2.9.0 (#4208)

2024-05-13 14:57:07 -07:00

utils.py

[Kernel] FP8 support for MoE kernel / Mixtral (#4244)

2024-04-24 01:18:23 +00:00

weight_utils.py

[Bugfix] Fix dummy weight for fp8 (#4916)

2024-05-20 18:44:25 +00:00