Chenyaaang f8977c233f

Fix an error in dummy weight loading for quantization models (#18855) ...

Signed-off-by: Chenyaaang <chenyangli@google.com>

2025-05-29 03:07:20 -07:00

..

__init__.py

[V1][Spec Decoding] Use model_loader.get_model() to load models (#18273)

2025-05-23 02:05:44 +00:00

base_loader.py

[V1][Spec Decoding] Use model_loader.get_model() to load models (#18273)

2025-05-23 02:05:44 +00:00

bitsandbytes_loader.py

[V1][Spec Decoding] Use model_loader.get_model() to load models (#18273)

2025-05-23 02:05:44 +00:00

default_loader.py

[Misc][ModelScope] Change to use runtime VLLM_USE_MODELSCOPE (#18655)

2025-05-25 04:51:21 +00:00

dummy_loader.py

[V1][Spec Decoding] Use model_loader.get_model() to load models (#18273)

2025-05-23 02:05:44 +00:00

gguf_loader.py

[V1][Spec Decoding] Use model_loader.get_model() to load models (#18273)

2025-05-23 02:05:44 +00:00

neuron.py

Update deprecated type hinting in model_loader (#18130)

2025-05-15 04:00:21 -07:00

neuronx_distributed.py

[Neuron] Add multi-LoRA support for Neuron. (#18284)

2025-05-29 16:41:22 +08:00

runai_streamer_loader.py

[V1][Spec Decoding] Use model_loader.get_model() to load models (#18273)

2025-05-23 02:05:44 +00:00

sharded_state_loader.py

[V1][Spec Decoding] Use model_loader.get_model() to load models (#18273)

2025-05-23 02:05:44 +00:00

tensorizer_loader.py

[Doc] Move examples and further reorganize user guide (#18666)

2025-05-26 07:38:04 -07:00

tensorizer.py

[Doc] Move examples and further reorganize user guide (#18666)

2025-05-26 07:38:04 -07:00

utils.py

[Bugfix] Fix transformers model impl ignored for mixtral quant (#18602)

2025-05-23 05:54:13 -07:00

weight_utils.py

Fix an error in dummy weight loading for quantization models (#18855)

2025-05-29 03:07:20 -07:00