xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-10 08:34:56 +08:00
Code Issues Packages Projects Releases Wiki Activity
vllm/examples/online_serving/disaggregated_serving
History
Reid 27d0952600
[Misc] extract parser.parse_args() (#18323) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
2025-05-19 04:06:26 +00:00
..
disagg_proxy_demo.py
[Misc] extract parser.parse_args() (#18323)
2025-05-19 04:06:26 +00:00
kv_events.sh
Improve examples rendering in docs and GitHub (#18203)
2025-05-15 15:57:49 +00:00
README.md
Improve examples rendering in docs and GitHub (#18203)
2025-05-15 15:57:49 +00:00

README.md

Disaggregated Serving

This example contains scripts that demonstrate the disaggregated serving features of vLLM.

Files

  • disagg_proxy_demo.py - Demonstrates XpYd (X prefill instances, Y decode instances).
  • kv_events.sh - Demonstrates KV cache event publishing.