xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-10 02:44:57 +08:00
Code Issues Packages Projects Releases Wiki Activity
vllm/examples/online_serving
History
Ce Gao a7e3eba66f
[Frontend] Support reasoning content for deepseek r1 (#12473) 
Signed-off-by: Ce Gao <cegao@tensorchord.ai>
Co-authored-by: Rafael Vasquez <rafvasq21@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Michael Goin <mgoin@redhat.com>
2025-01-29 11:38:08 +08:00
..
chart-helm
[Doc] Move examples into categories (#11840)
2025-01-08 13:09:53 +00:00
opentelemetry
[Doc] Move examples into categories (#11840)
2025-01-08 13:09:53 +00:00
prometheus_grafana
Fix bad path in prometheus example (#12481)
2025-01-27 18:56:31 -07:00
api_client.py
[Doc] Move examples into categories (#11840)
2025-01-08 13:09:53 +00:00
cohere_rerank_client.py
[Frontend] Rerank API (Jina- and Cohere-compatible API) (#12376)
2025-01-26 19:58:45 -07:00
disaggregated_prefill.sh
[Bugfix] Fix a path bug in disaggregated prefill example script. (#12121)
2025-01-17 11:12:41 +08:00
gradio_openai_chatbot_webserver.py
[Doc] Move examples into categories (#11840)
2025-01-08 13:09:53 +00:00
gradio_webserver.py
[Doc] Move examples into categories (#11840)
2025-01-08 13:09:53 +00:00
jinaai_rerank_client.py
[Frontend] Rerank API (Jina- and Cohere-compatible API) (#12376)
2025-01-26 19:58:45 -07:00
openai_chat_completion_client_for_multimodal.py
Replace "online inference" with "online serving" (#11923)
2025-01-10 12:05:56 +00:00
openai_chat_completion_client_with_tools.py
[Doc] Move examples into categories (#11840)
2025-01-08 13:09:53 +00:00
openai_chat_completion_client.py
[Doc] Move examples into categories (#11840)
2025-01-08 13:09:53 +00:00
openai_chat_completion_structured_outputs.py
[Doc] Move examples into categories (#11840)
2025-01-08 13:09:53 +00:00
openai_chat_completion_with_reasoning_streaming.py
[Frontend] Support reasoning content for deepseek r1 (#12473)
2025-01-29 11:38:08 +08:00
openai_chat_completion_with_reasoning.py
[Frontend] Support reasoning content for deepseek r1 (#12473)
2025-01-29 11:38:08 +08:00
openai_chat_embedding_client_for_multimodal.py
[Doc] Move examples into categories (#11840)
2025-01-08 13:09:53 +00:00
openai_completion_client.py
[Doc] Move examples into categories (#11840)
2025-01-08 13:09:53 +00:00
openai_cross_encoder_score.py
[Doc] Move examples into categories (#11840)
2025-01-08 13:09:53 +00:00
openai_embedding_client.py
[Doc] Move examples into categories (#11840)
2025-01-08 13:09:53 +00:00
openai_pooling_client.py
[Doc] Move examples into categories (#11840)
2025-01-08 13:09:53 +00:00
run_cluster.sh
[Doc] Move examples into categories (#11840)
2025-01-08 13:09:53 +00:00
sagemaker-entrypoint.sh
[Doc] Move examples into categories (#11840)
2025-01-08 13:09:53 +00:00