Rui Qiao f26c4aeecb

[Misc] Optimize ray worker initialization time (#11275) ...

Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

2024-12-18 23:38:02 -08:00

..

__init__.py

Add distributed model executor abstraction (#3191)

2024-03-11 11:03:45 -07:00

cpu_executor.py

[core][executor] simplify instance id (#10976)

2024-12-07 09:33:45 -08:00

distributed_gpu_executor.py

[Frontend] Log the maximum supported concurrency (#8831)

2024-10-09 00:03:14 -07:00

executor_base.py

[2/N] executor pass the complete config to worker/modelrunner (#9938)

2024-11-02 07:35:05 -07:00

gpu_executor.py

[platforms] absorb worker cls difference into platforms folder (#10555)

2024-11-21 21:00:32 -08:00

hpu_executor.py

[platforms] absorb worker cls difference into platforms folder (#10555)

2024-11-21 21:00:32 -08:00

msgspec_utils.py

[Core] Optimize SPMD architecture with delta + serialization optimization (#7109)

2024-08-18 17:57:20 -07:00

multiproc_gpu_executor.py

[V1] Multiprocessing Tensor Parallel Support for v1 (#9856)

2024-12-10 06:28:14 +00:00

multiproc_worker_utils.py

[Core] V1: Use multiprocessing by default (#11074)

2024-12-13 16:27:32 -08:00

multiproc_xpu_executor.py

[Hardware][Intel GPU] Add intel GPU pipeline parallel support. (#7810)

2024-08-27 10:07:02 -07:00

neuron_executor.py

[Bugfix] Fix OpenVino/Neuron driver_worker init (#10779)

2024-11-30 12:07:13 +08:00

openvino_executor.py

[Bugfix] Fix OpenVino/Neuron driver_worker init (#10779)

2024-11-30 12:07:13 +08:00

ray_gpu_executor.py

[Misc] Optimize ray worker initialization time (#11275)

2024-12-18 23:38:02 -08:00

ray_hpu_executor.py

[core][misc] remove use_dummy driver for _run_workers (#10920)

2024-12-07 12:06:08 -08:00

ray_tpu_executor.py

[core][misc] remove use_dummy driver for _run_workers (#10920)

2024-12-07 12:06:08 -08:00

ray_utils.py

[Distributed] Allow the placement group more time to wait for resources to be ready (#11138)

2024-12-13 20:17:37 +00:00

ray_xpu_executor.py

[core][misc] remove use_dummy driver for _run_workers (#10920)

2024-12-07 12:06:08 -08:00

tpu_executor.py

[2/N] executor pass the complete config to worker/modelrunner (#9938)

2024-11-02 07:35:05 -07:00

xpu_executor.py

[platforms] absorb worker cls difference into platforms folder (#10555)

2024-11-21 21:00:32 -08:00