Yihua Cheng 3408e47159

[P/D][V1] KV Connector API V1 (#15960) ...

Signed-off-by: ApostaC <yihua98@uchicago.edu>
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
Signed-off-by: remi <remi@mistral.ai>
Co-authored-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Rémi Delacourt <54138269+Flechman@users.noreply.github.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>

2025-04-17 13:22:40 -07:00

..

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

cache_engine.py

[Attention] Get rid of mla cache alignment (#14842)

2025-03-15 05:08:25 +00:00

cpu_enc_dec_model_runner.py

Remove unused kwargs from model definitions (#13555)

2025-02-24 17:13:52 -08:00

cpu_model_runner.py

[Kernel][CPU] CPU MLA (#14744)

2025-03-25 09:34:59 +00:00

cpu_pooling_model_runner.py

Remove unused kwargs from model definitions (#13555)

2025-02-24 17:13:52 -08:00

cpu_worker.py

[CPU][Bugfix] Using custom allreduce for CPU backend (#15934)

2025-04-02 07:46:47 -07:00

enc_dec_model_runner.py

[Core][LoRA][1/N] Add LoRA for EncoderDecoderModelRunner (#15990)

2025-04-11 15:32:37 +08:00

hpu_model_runner.py

[Hardware][Intel-Gaudi] Multi-step scheduling implementation for HPU (#12779)

2025-04-11 07:38:36 -07:00

hpu_worker.py

[PP] Correct cache size check (#13873)

2025-02-27 17:47:29 +08:00

model_runner_base.py

[Bugfix] Do not crash V0 engine on input errors (#13101)

2025-02-26 19:07:29 +08:00

model_runner.py

[P/D][V1] KV Connector API V1 (#15960)

2025-04-17 13:22:40 -07:00

multi_step_hpu_worker.py

[Hardware][Intel-Gaudi] Multi-step scheduling implementation for HPU (#12779)

2025-04-11 07:38:36 -07:00

multi_step_model_runner.py

Remove unused kwargs from model definitions (#13555)

2025-02-24 17:13:52 -08:00

multi_step_tpu_worker.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

multi_step_worker.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

neuron_model_runner.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

neuron_worker.py

[Misc] Improve LoRA spelling (#13831)

2025-02-25 23:43:01 -08:00

pooling_model_runner.py

Remove unused kwargs from model definitions (#13555)

2025-02-24 17:13:52 -08:00

tpu_model_runner.py

Remove unused kwargs from model definitions (#13555)

2025-02-24 17:13:52 -08:00

tpu_worker.py

[TPU] support disabling xla compilation cache (#15567)

2025-03-27 00:09:28 +00:00

utils.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

worker_base.py

[RLHF] use worker_extension_cls for compatibility with V0 and V1 (#14185)

2025-03-07 00:32:46 +08:00

worker.py

[P/D][V1] KV Connector API V1 (#15960)

2025-04-17 13:22:40 -07:00

xpu_model_runner.py

fix: change GB to GiB in logging close #14979 (#15807)

2025-03-31 10:00:50 -07:00

xpu_worker.py

[Misc] Improve LoRA spelling (#13831)

2025-02-25 23:43:01 -08:00