Tyler Michael Smith 28b3a1c7e5

[V1] Multiprocessing Tensor Parallel Support for v1 (#9856) ...

Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>

2024-12-10 06:28:14 +00:00

..

__init__.py

Add distributed model executor abstraction (#3191)

2024-03-11 11:03:45 -07:00

cpu_executor.py

[core][executor] simplify instance id (#10976)

2024-12-07 09:33:45 -08:00

distributed_gpu_executor.py

[Frontend] Log the maximum supported concurrency (#8831)

2024-10-09 00:03:14 -07:00

executor_base.py

[2/N] executor pass the complete config to worker/modelrunner (#9938)

2024-11-02 07:35:05 -07:00

gpu_executor.py

[platforms] absorb worker cls difference into platforms folder (#10555)

2024-11-21 21:00:32 -08:00

hpu_executor.py

[platforms] absorb worker cls difference into platforms folder (#10555)

2024-11-21 21:00:32 -08:00

msgspec_utils.py

[Core] Optimize SPMD architecture with delta + serialization optimization (#7109)

2024-08-18 17:57:20 -07:00

multiproc_gpu_executor.py

[V1] Multiprocessing Tensor Parallel Support for v1 (#9856)

2024-12-10 06:28:14 +00:00

multiproc_worker_utils.py

[V1] Multiprocessing Tensor Parallel Support for v1 (#9856)

2024-12-10 06:28:14 +00:00

multiproc_xpu_executor.py

[Hardware][Intel GPU] Add intel GPU pipeline parallel support. (#7810)

2024-08-27 10:07:02 -07:00

neuron_executor.py

[Bugfix] Fix OpenVino/Neuron driver_worker init (#10779)

2024-11-30 12:07:13 +08:00

openvino_executor.py

[Bugfix] Fix OpenVino/Neuron driver_worker init (#10779)

2024-11-30 12:07:13 +08:00

ray_gpu_executor.py

[core][misc] remove use_dummy driver for _run_workers (#10920)

2024-12-07 12:06:08 -08:00

ray_hpu_executor.py

[core][misc] remove use_dummy driver for _run_workers (#10920)

2024-12-07 12:06:08 -08:00

ray_tpu_executor.py

[core][misc] remove use_dummy driver for _run_workers (#10920)

2024-12-07 12:06:08 -08:00

ray_utils.py

[Bugfix] Ignore ray reinit error when current platform is ROCm or XPU (#10375)

2024-11-18 11:29:26 +08:00

ray_xpu_executor.py

[core][misc] remove use_dummy driver for _run_workers (#10920)

2024-12-07 12:06:08 -08:00

tpu_executor.py

[2/N] executor pass the complete config to worker/modelrunner (#9938)

2024-11-02 07:35:05 -07:00

xpu_executor.py

[platforms] absorb worker cls difference into platforms folder (#10555)

2024-11-21 21:00:32 -08:00