mirror of
https://git.datalinker.icu/vllm-project/vllm.git
synced 2025-12-23 20:06:21 +08:00
0590ec3fd9
This PR provides initial support for single-node disaggregated prefill in 1P1D scenario. Signed-off-by: KuntaiDu <kuntai@uchicago.edu> Co-authored-by: ApostaC <yihua98@uchicago.edu> Co-authored-by: YaoJiayi <120040070@link.cuhk.edu.cn>
3 lines
87 B
Bash
3 lines
87 B
Bash
#!/bin/bash
|
|
RANK=0 python test_lookup_buffer.py &
|
|
RANK=1 python test_lookup_buffer.py & |