Woosuk Kwon 0c2fa50b84

[TPU] Use mark_dynamic only for dummy run (#7634)

2024-08-18 00:18:53 -07:00

..

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

cache_engine.py

[Model] Jamba support (#4115)

2024-07-02 23:11:29 +00:00

cpu_model_runner.py

[VLM] Refactor MultiModalConfig initialization and profiling (#7530)

2024-08-17 13:30:55 -07:00

cpu_worker.py

[VLM] Refactor MultiModalConfig initialization and profiling (#7530)

2024-08-17 13:30:55 -07:00

embedding_model_runner.py

[VLM] Refactor MultiModalConfig initialization and profiling (#7530)

2024-08-17 13:30:55 -07:00

enc_dec_model_runner.py

[VLM] Refactor MultiModalConfig initialization and profiling (#7530)

2024-08-17 13:30:55 -07:00

model_runner_base.py

[BugFix] Fix use of per-request seed with pipeline parallel (#6698)

2024-07-30 10:40:08 -07:00

model_runner.py

[VLM] Refactor MultiModalConfig initialization and profiling (#7530)

2024-08-17 13:30:55 -07:00

neuron_model_runner.py

[Bugfix] update neuron for version > 0.5.0 (#7175)

2024-08-15 09:44:14 -07:00

neuron_worker.py

[Bugfix] update neuron for version > 0.5.0 (#7175)

2024-08-15 09:44:14 -07:00

openvino_model_runner.py

[Bugfix] Fix broadcasting logic for multi_modal_kwargs (#6836)

2024-07-31 10:38:45 +08:00

openvino_worker.py

[core][distributed] support n layers % pp size != 0 (#6115)

2024-07-03 16:40:31 -07:00

tpu_model_runner.py

[TPU] Use mark_dynamic only for dummy run (#7634)

2024-08-18 00:18:53 -07:00

tpu_worker.py

[TPU] Skip creating empty tensor (#7630)

2024-08-17 14:22:46 -07:00

utils.py

[VLM] Refactor MultiModalConfig initialization and profiling (#7530)

2024-08-17 13:30:55 -07:00

worker_base.py

[misc][plugin] add plugin system implementation (#7426)

2024-08-13 16:24:17 -07:00

worker.py

[VLM] Refactor MultiModalConfig initialization and profiling (#7530)

2024-08-17 13:30:55 -07:00

xpu_model_runner.py

[VLM] Refactor MultiModalConfig initialization and profiling (#7530)

2024-08-17 13:30:55 -07:00

xpu_worker.py

[ci] set timeout for test_oot_registration.py (#7082)

2024-08-02 10:03:24 -07:00