xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-10 03:35:17 +08:00
Code Issues Packages Projects Releases Wiki Activity
vllm/benchmarks/disagg_benchmarks
History
Kuntai Du 0590ec3fd9
[Core] Implement disagg prefill by StatelessProcessGroup (#10502) 
This PR provides initial support for single-node disaggregated prefill in 1P1D scenario.
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
Co-authored-by: ApostaC <yihua98@uchicago.edu>
Co-authored-by: YaoJiayi <120040070@link.cuhk.edu.cn>
2024-12-01 19:01:00 -06:00
..
disagg_overhead_benchmark.sh
[Core] Implement disagg prefill by StatelessProcessGroup (#10502)
2024-12-01 19:01:00 -06:00
disagg_performance_benchmark.sh
[Core] Implement disagg prefill by StatelessProcessGroup (#10502)
2024-12-01 19:01:00 -06:00
disagg_prefill_proxy_server.py
[Core] Implement disagg prefill by StatelessProcessGroup (#10502)
2024-12-01 19:01:00 -06:00
round_robin_proxy.py
[Core] Implement disagg prefill by StatelessProcessGroup (#10502)
2024-12-01 19:01:00 -06:00
visualize_benchmark_results.py
[Core] Implement disagg prefill by StatelessProcessGroup (#10502)
2024-12-01 19:01:00 -06:00