youkaichao 96b6a6d790

[Bugfix] fix type hint for py 3.8 (#4036)

2024-04-12 19:35:44 +00:00

..

__init__.py

Add distributed model executor abstraction (#3191)

2024-03-11 11:03:45 -07:00

cpu_executor.py

[Hardware][Intel] Isolate CPUModelRunner and ModelRunner for better maintenance (#3824)

2024-04-11 11:56:49 -07:00

executor_base.py

[Bugfix] fix type hint for py 3.8 (#4036)

2024-04-12 19:35:44 +00:00

gpu_executor.py

[Misc] [Core] Implement RFC "Augment BaseExecutor interfaces to enable hardware-agnostic speculative decoding" (#3837)

2024-04-09 11:44:15 -07:00

neuron_executor.py

[Misc] [Core] Implement RFC "Augment BaseExecutor interfaces to enable hardware-agnostic speculative decoding" (#3837)

2024-04-09 11:44:15 -07:00

ray_gpu_executor.py

[Misc] [Core] Implement RFC "Augment BaseExecutor interfaces to enable hardware-agnostic speculative decoding" (#3837)

2024-04-09 11:44:15 -07:00