xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-10 03:15:20 +08:00
Code Issues Packages Projects Releases Wiki Activity
vllm/examples/online_serving
History
Zuxin 1d0ae26c85
Add xLAM tool parser support (#17148)
2025-06-19 14:26:41 +08:00
..
chart-helm
Update PyTorch to 2.7.0 (#16859)
2025-04-29 19:08:04 -07:00
disagg_xpyd
[V1][P/D] An native implementation of xPyD based on P2P NCCL (#18242)
2025-06-18 06:32:36 +00:00
disaggregated_serving
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
opentelemetry
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
prometheus_grafana
[V1][Metrics] Remove metrics that were deprecated in 0.8 (#18837)
2025-05-28 18:54:12 +00:00
structured_outputs
[Doc] uses absolute links for structured outputs (#19582)
2025-06-13 03:35:17 +00:00
api_client.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
cohere_rerank_client.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
disaggregated_prefill.sh
[Frontend][Bugfix] support prefill decode disaggregation on deepseek (#14824)
2025-03-20 00:00:33 -07:00
gradio_openai_chatbot_webserver.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
gradio_webserver.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
jinaai_rerank_client.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
kv_events_subscriber.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
multi_instance_data_parallel.py
Allow AsyncLLMEngine.generate to target a specific DP rank (#19102)
2025-06-04 08:26:47 -07:00
multi-node-serving.sh
[Misc] Adding script to setup ray for multi-node vllm deployments (#12913)
2025-02-20 21:16:40 -08:00
openai_chat_completion_client_for_multimodal.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
openai_chat_completion_client_with_tools_required.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
openai_chat_completion_client_with_tools_xlam_streaming.py
Add xLAM tool parser support (#17148)
2025-06-19 14:26:41 +08:00
openai_chat_completion_client_with_tools_xlam.py
Add xLAM tool parser support (#17148)
2025-06-19 14:26:41 +08:00
openai_chat_completion_client_with_tools.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
openai_chat_completion_client.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
openai_chat_completion_tool_calls_with_reasoning.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
openai_chat_completion_with_reasoning_streaming.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
openai_chat_completion_with_reasoning.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
openai_chat_embedding_client_for_multimodal.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
openai_classification_client.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
openai_completion_client.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
openai_cross_encoder_score.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
openai_embedding_client.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
openai_embedding_matryoshka_fy.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
openai_pooling_client.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
openai_transcription_client.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
prompt_embed_inference_with_openai_client.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
ray_serve_deepseek.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
retrieval_augmented_generation_with_langchain.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
retrieval_augmented_generation_with_llamaindex.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
run_cluster.sh
[Doc] Move examples into categories (#11840)
2025-01-08 13:09:53 +00:00
sagemaker-entrypoint.sh
[Doc] Move examples into categories (#11840)
2025-01-08 13:09:53 +00:00
streamlit_openai_chatbot_webserver.py
[DOC] Add reasoning capability to vLLM streamlit code (#19557)
2025-06-16 07:09:12 -04:00
utils.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00