mirror of
https://git.datalinker.icu/vllm-project/vllm.git
synced 2025-12-21 12:45:01 +08:00
parent
d3b5b98021
commit
57792ed469
@ -1,6 +1,6 @@
|
||||
"""
|
||||
This example shows how to use vLLM for running offline inference
|
||||
with the correct prompt format on vision language models.
|
||||
with the correct prompt format on audio language models.
|
||||
|
||||
For most models, the prompt format should follow corresponding examples
|
||||
on HuggingFace model repository.
|
||||
|
||||
Loading…
x
Reference in New Issue
Block a user