Nick Hill 479d69fad0

[Core] Move ray_utils.py from engine to executor package (#4347)

2024-04-25 06:52:22 +00:00

..

__init__.py

Add distributed model executor abstraction (#3191)

2024-03-11 11:03:45 -07:00

cpu_executor.py

[Frontend] Enable support for CPU backend in AsyncLLMEngine. (#3993)

2024-04-22 09:19:51 +00:00

executor_base.py

[Speculative decoding 6/9] Integrate speculative decoding with LLMEngine (#3894)

2024-04-16 13:09:21 -07:00

gpu_executor.py

[Speculative decoding 7/9] Speculative decoding end-to-end correctness tests. (#3951)

2024-04-23 08:02:36 +00:00

neuron_executor.py

[CI/CD] add neuron docker and ci test scripts (#3571)

2024-04-18 15:26:01 -07:00

ray_gpu_executor.py

[Core] Move ray_utils.py from engine to executor package (#4347)

2024-04-25 06:52:22 +00:00

ray_utils.py

[Core] Move ray_utils.py from engine to executor package (#4347)

2024-04-25 06:52:22 +00:00