7 Commits

Author	SHA1	Message	Date
youkaichao	63e7176f26	[Core][Refactor] move parallel_utils into vllm/distributed (#3950) ... [WIP][Core][Refactor] move vllm/model_executor/parallel_utils into vllm/distributed and vllm/device_communicators (#3950)	2024-04-10 15:33:30 -07:00
youkaichao	6d592eb430	[Core] separate distributed_init from worker (#3904)	2024-04-09 08:49:02 +00:00
youkaichao	756b30a5f3	[Core][Test] move local_rank to the last arg with default value(#3711) ... [Core][Test] move local_rank to the last arg with default value to keep api compatible (#3711)	2024-03-28 21:19:45 -07:00
Roy	515386ef3c	[Core] Support multi-node inference(eager and cuda graph) (#3686)	2024-03-28 15:01:55 -07:00
youkaichao	8f44facddd	[Core] remove cupy dependency (#3625)	2024-03-27 00:33:26 -07:00
Woosuk Kwon	a463c333dd	Use CuPy for CUDA graphs (#2811)	2024-02-13 11:32:06 -08:00
Hanzhi Zhou	380170038e	Implement custom all reduce kernels (#2192)	2024-01-27 12:46:35 -08:00