xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2026-01-28 15:47:14 +08:00
Code Issues Packages Projects Releases Wiki Activity

config.py: Clarify that only local GGUF checkpoints are supported. (#18623)

Browse Source 
Signed-off-by: Mathieu Bordere <mathieu@letmetweakit.com>
This commit is contained in:
Mathieu Borderé 2025-05-24 02:46:34 +02:00 committed by GitHub
parent 2b10ba7491
commit 45ab403a1f
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 4 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
vllm/transformers_utils/config.py
View File

@ -300,7 +300,10 @@ def get_config(
" - For Hugging Face models: ensure the presence of a "
"'config.json'.\n"
" - For Mistral models: ensure the presence of a "
"'params.json'.\n").format(model=model)
"'params.json'.\n"
"3. For GGUF: pass the local path of the GGUF checkpoint.\n"
" Loading GGUF from a remote repo directly is not yet "
"supported.\n").format(model=model)
raise ValueError(error_message) from e