youkaichao 515080ad2f

[bugfix][distributed] fix shm broadcast when the queue size is full (#5801)

2024-06-25 21:56:02 -07:00

..

device_communicators

[bugfix][distributed] fix shm broadcast when the queue size is full (#5801)

2024-06-25 21:56:02 -07:00

__init__.py

[Core][Refactor] move parallel_utils into vllm/distributed (#3950)

2024-04-10 15:33:30 -07:00

communication_op.py

[Core][Distributed] code deduplication in tp&pp with coordinator(#5293)

2024-06-12 17:27:08 -07:00

parallel_state.py

[Speculative Decoding] Support draft model on different tensor-parallel size than target model (#5414)

2024-06-25 09:56:06 +00:00

utils.py

[Core][Distributed] improve p2p access check (#4992)

2024-05-29 11:29:07 +00:00