xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-14 00:05:36 +08:00
Code Issues Packages Projects Releases Wiki Activity

[Bugfix][Doc] Fix Doc Formatting (#6048)

Browse Source
This commit is contained in:
Roger Wang 2024-07-01 15:09:11 -07:00 committed by GitHub
parent 83bdcb6ac3
commit 8e0817c262
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
docs/source/serving/faq.rst
View File

@ -1,5 +1,5 @@
Frequently Asked Questions Frequently Asked Questions
======================== ===========================
Q: How can I serve multiple models on a single port using the OpenAI API? Q: How can I serve multiple models on a single port using the OpenAI API?
@ -9,4 +9,4 @@ A: Assuming that you're referring to using OpenAI compatible server to serve mul
Q: Which model to use for offline inference embedding? Q: Which model to use for offline inference embedding?
A: If you want to use an embedding model, try: https://huggingface.co/intfloat/e5-mistral-7b-instruct. Instead models, such as Llama-3-8b, Mistral-7B-Instruct-v0.3, are generation models rather than an embedding model A: If you want to use an embedding model, try: https://huggingface.co/intfloat/e5-mistral-7b-instruct. Instead models, such as Llama-3-8b, Mistral-7B-Instruct-v0.3, are generation models rather than an embedding model