mirror of
https://git.datalinker.icu/vllm-project/vllm.git
synced 2026-05-22 12:04:28 +08:00
parent
2e090bd5df
commit
dff680001d
@ -70,7 +70,7 @@ Try one yourself by passing one of the following models to the `--model` argumen
|
|||||||
|
|
||||||
vLLM supports models that are quantized using GGUF.
|
vLLM supports models that are quantized using GGUF.
|
||||||
|
|
||||||
Try one yourself by downloading a GUFF quantised model and using the following arguments:
|
Try one yourself by downloading a quantized GGUF model and using the following arguments:
|
||||||
|
|
||||||
```python
|
```python
|
||||||
from huggingface_hub import hf_hub_download
|
from huggingface_hub import hf_hub_download
|
||||||
|
|||||||
Loading…
x
Reference in New Issue
Block a user