liangwen12year de3e53a75b

feat: Add Grafana and Perces monitoring dashboards for vLLM (#23498)

2025-09-16 05:53:40 -07:00

..

chart-helm

[V0 deprecation] Remove V0 CPU/XPU/TPU backends (#20412)

2025-07-06 08:48:13 -07:00

dashboards

feat: Add Grafana and Perces monitoring dashboards for vLLM (#23498)

2025-09-16 05:53:40 -07:00

disaggregated_serving

[Bugfix][PD] set max_completion_tokens=1 if req has this value (#21841)

2025-08-01 06:08:45 -07:00

disaggregated_serving_p2p_nccl_xpyd

[Bugfix][V1][P/D]Fix the uneven polling issue in the toy proxy for P2pNcclConnector (#21819)

2025-08-04 20:17:05 +00:00

elastic_ep

Elastic Expert Parallel Initial Support (#20775)

2025-07-18 17:46:09 -07:00

openai_embedding_long_text

[Misc] Fix examples openai_pooling_client.py (#24853)

2025-09-15 11:57:30 +00:00

opentelemetry

…

pooling

[Misc] Fix examples openai_pooling_client.py (#24853)

2025-09-15 11:57:30 +00:00

prometheus_grafana

[Metrics] Deprecate TPOT in favor of ITL (#24110)

2025-09-02 18:10:10 +00:00

structured_outputs

…

api_client.py

…

disaggregated_prefill.sh

Remove deprecated PyNcclConnector (#24151)

2025-09-03 22:49:16 +00:00

gradio_openai_chatbot_webserver.py

…

gradio_webserver.py

…

kv_events_subscriber.py

[Core] Use sha256 bytes instead of BlockHash to reduce GC overhead (#23673)

2025-09-08 21:34:37 -07:00

multi_instance_data_parallel.py

…

multi-node-serving.sh

correct LWS deployment yaml (#23104)

2025-09-02 12:04:59 +00:00

openai_chat_completion_client_for_multimodal.py

[Gemma3n] Fix audio batching (#24052)

2025-09-02 22:23:35 +08:00

openai_chat_completion_client_with_tools_required.py

…

openai_chat_completion_client_with_tools_xlam_streaming.py

…

openai_chat_completion_client_with_tools_xlam.py

…

openai_chat_completion_client_with_tools.py

…

openai_chat_completion_client.py

…

openai_chat_completion_tool_calls_with_reasoning.py

…

openai_chat_completion_with_reasoning_streaming.py

[Docs] Fix the example code of streaming chat completions in reasoning (#21825)

2025-07-30 12:11:58 +00:00

openai_chat_completion_with_reasoning.py

…

openai_completion_client.py

…

openai_cross_encoder_score_for_multimodal.py

[Deprecation][2/N] Replace --task with --runner and --convert (#21470)

2025-07-27 19:42:40 -07:00

openai_cross_encoder_score.py

[Deprecation][2/N] Replace --task with --runner and --convert (#21470)

2025-07-27 19:42:40 -07:00

openai_transcription_client.py

…

openai_translation_client.py

…

prithvi_geospatial_mae.py

[Misc] Terratorch related fixes (#24337)

2025-09-08 06:40:26 -07:00

prompt_embed_inference_with_openai_client.py

[Deprecation][2/N] Replace --task with --runner and --convert (#21470)

2025-07-27 19:42:40 -07:00

ray_serve_deepseek.py

[Docs] Improve documentation for Deepseek R1 on Ray Serve LLM (#20601)

2025-07-08 02:09:06 -07:00

retrieval_augmented_generation_with_langchain.py

…

retrieval_augmented_generation_with_llamaindex.py

…

run_cluster.sh

[Docs] Improve documentation for ray cluster launcher helper script (#20602)

2025-07-15 03:55:45 -07:00

sagemaker-entrypoint.sh

…

streamlit_openai_chatbot_webserver.py

…

utils.py

…