kushanam c334b1898b

extend cuda graph size for H200 (#7894) ...

Co-authored-by: youkaichao <youkaichao@126.com>

2024-08-29 12:15:04 -07:00

..

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

cache_engine.py

[Model] Jamba support (#4115)

2024-07-02 23:11:29 +00:00

cpu_model_runner.py

[Bugfix][Hardware][CPU] Fix mm_limits initialization for CPU backend (#7735)

2024-08-21 16:23:03 +00:00

cpu_worker.py

[misc] Add Torch profiler support for CPU-only devices (#7806)

2024-08-23 05:46:25 +00:00

embedding_model_runner.py

[VLM] Refactor MultiModalConfig initialization and profiling (#7530)

2024-08-17 13:30:55 -07:00

enc_dec_model_runner.py

[Core] Add AttentionState abstraction (#7663)

2024-08-20 18:50:45 +00:00

model_runner_base.py

[core] Multi Step Scheduling (#7000)

2024-08-19 13:52:13 -07:00

model_runner.py

extend cuda graph size for H200 (#7894)

2024-08-29 12:15:04 -07:00

multi_step_model_runner.py

[Core] Combine async postprocessor and multi-step (#7921)

2024-08-29 11:18:26 -07:00

multi_step_worker.py

[Core] Combine async postprocessor and multi-step (#7921)

2024-08-29 11:18:26 -07:00

neuron_model_runner.py

[Bugfix] update neuron for version > 0.5.0 (#7175)

2024-08-15 09:44:14 -07:00

neuron_worker.py

[Bugfix] neuron: enable tensor parallelism (#7562)

2024-08-26 15:13:13 -07:00

openvino_model_runner.py

[Bugfix] Fix broadcasting logic for multi_modal_kwargs (#6836)

2024-07-31 10:38:45 +08:00

openvino_worker.py

[core][distributed] support n layers % pp size != 0 (#6115)

2024-07-03 16:40:31 -07:00

tpu_model_runner.py

[torch.compile] avoid Dynamo guard evaluation overhead (#7898)

2024-08-28 16:10:12 -07:00

tpu_worker.py

[torch.compile] remove reset (#7975)

2024-08-28 17:32:26 -07:00

utils.py

[VLM] Refactor MultiModalConfig initialization and profiling (#7530)

2024-08-17 13:30:55 -07:00

worker_base.py

[Core] Async_output_proc: Add virtual engine support (towards pipeline parallel) (#7911)

2024-08-28 00:02:30 -07:00

worker.py

[Speculative Decoding] EAGLE Implementation with Top-1 proposer (#6830)

2024-08-22 02:42:24 -07:00

xpu_model_runner.py

[Hardware][Intel GPU] Add intel GPU pipeline parallel support. (#7810)

2024-08-27 10:07:02 -07:00

xpu_worker.py

[Hardware][Intel GPU] Add intel GPU pipeline parallel support. (#7810)

2024-08-27 10:07:02 -07:00