mirror of
https://git.datalinker.icu/vllm-project/vllm.git
synced 2025-12-15 10:46:18 +08:00
parent
d3b5b98021
commit
57792ed469
@ -1,6 +1,6 @@
|
|||||||
"""
|
"""
|
||||||
This example shows how to use vLLM for running offline inference
|
This example shows how to use vLLM for running offline inference
|
||||||
with the correct prompt format on vision language models.
|
with the correct prompt format on audio language models.
|
||||||
|
|
||||||
For most models, the prompt format should follow corresponding examples
|
For most models, the prompt format should follow corresponding examples
|
||||||
on HuggingFace model repository.
|
on HuggingFace model repository.
|
||||||
|
|||||||
Loading…
x
Reference in New Issue
Block a user