Tsukasa OI 42c1949643

[Bugfix][Quantization] Support BF16 tensors on GGUF (#29948) ...

Signed-off-by: Tsukasa OI <floss_llm@irq.a4lg.com>

2025-12-03 10:33:46 +00:00

..

__init__.py

Default model load/config/tokenizer to mistral format if relevant files exist (#28659)

2025-11-21 13:58:59 -08:00

base_loader.py

…

bitsandbytes_loader.py

…

default_loader.py

[Chore]: Reorganize model repo operating functions in transformers_utils (#29680)

2025-11-28 08:46:51 -08:00

dummy_loader.py

…

gguf_loader.py

[Feature]: Improve GGUF loading from HuggingFace user experience like repo_id:quant_type (#29137)

2025-11-25 14:28:53 +00:00

online_quantization.py

Move online quantization to model.load_weights (#26327)

2025-11-18 16:52:41 -08:00

runai_streamer_loader.py

…

sharded_state_loader.py

[log] add weights loading time log to sharded_state loader (#28628)

2025-11-21 21:06:09 +00:00

tensorizer_loader.py

…

tensorizer.py

…

tpu.py

…

utils.py

[Attention] Remove imports from vllm/attention/__init__.py (#29342)

2025-11-26 10:53:15 -07:00

weight_utils.py

[Bugfix][Quantization] Support BF16 tensors on GGUF (#29948)

2025-12-03 10:33:46 +00:00