xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2026-04-04 01:27:10 +08:00
Code Issues Packages Projects Releases Wiki Activity
vllm/examples/online_serving/disaggregated_serving
History
inkcherry 63e6cff196 update proxy path 
Signed-off-by: inkcherry <mingzhi.liu@amd.com>
2025-11-27 07:30:59 +00:00
..
disagg_proxy_demo.py
…
kv_events.sh
…
moriio_toy_proxy_server.py
update proxy path
2025-11-27 07:30:59 +00:00
README.md
…

README.md

Disaggregated Serving

This example contains scripts that demonstrate the disaggregated serving features of vLLM.

Files

  • disagg_proxy_demo.py - Demonstrates XpYd (X prefill instances, Y decode instances).
  • kv_events.sh - Demonstrates KV cache event publishing.