Jee Jee Li b8b0ccbd2d

[Bugfix] Make the deviceprofiler include LoRA memory. (#14469) ...

Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>

2025-03-08 07:12:22 +00:00

..

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

cache_engine.py

Use math.prod instead of np.prod for trivial ops (#14142)

2025-03-03 21:09:22 -08:00

cpu_enc_dec_model_runner.py

Remove unused kwargs from model definitions (#13555)

2025-02-24 17:13:52 -08:00

cpu_model_runner.py

Remove unused kwargs from model definitions (#13555)

2025-02-24 17:13:52 -08:00

cpu_pooling_model_runner.py

Remove unused kwargs from model definitions (#13555)

2025-02-24 17:13:52 -08:00

cpu_worker.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

enc_dec_model_runner.py

Remove unused kwargs from model definitions (#13555)

2025-02-24 17:13:52 -08:00

hpu_model_runner.py

[Hardware][Intel-Gaudi] Regional compilation support (#13213)

2025-02-28 00:51:49 -08:00

hpu_worker.py

[PP] Correct cache size check (#13873)

2025-02-27 17:47:29 +08:00

model_runner_base.py

[Bugfix] Do not crash V0 engine on input errors (#13101)

2025-02-26 19:07:29 +08:00

model_runner.py

[Bugfix] Make the deviceprofiler include LoRA memory. (#14469)

2025-03-08 07:12:22 +00:00

multi_step_model_runner.py

Remove unused kwargs from model definitions (#13555)

2025-02-24 17:13:52 -08:00

multi_step_tpu_worker.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

multi_step_worker.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

neuron_model_runner.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

neuron_worker.py

[Misc] Improve LoRA spelling (#13831)

2025-02-25 23:43:01 -08:00

openvino_model_runner.py

Fix missing kv_caches and attn_metadata in OpenVINOCausalLM (#14271)

2025-03-07 12:30:42 +00:00

openvino_worker.py

[Misc] Improve LoRA spelling (#13831)

2025-02-25 23:43:01 -08:00

pooling_model_runner.py

Remove unused kwargs from model definitions (#13555)

2025-02-24 17:13:52 -08:00

tpu_model_runner.py

Remove unused kwargs from model definitions (#13555)

2025-02-24 17:13:52 -08:00

tpu_worker.py

[TPU][Profiler] Support start_profile/stop_profile in TPU worker (#13988)

2025-03-04 14:40:06 -05:00

utils.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

worker_base.py

[RLHF] use worker_extension_cls for compatibility with V0 and V1 (#14185)

2025-03-07 00:32:46 +08:00

worker.py

[PP] Correct cache size check (#13873)

2025-02-27 17:47:29 +08:00

xpu_model_runner.py

Remove unused kwargs from model definitions (#13555)

2025-02-24 17:13:52 -08:00

xpu_worker.py

[Misc] Improve LoRA spelling (#13831)

2025-02-25 23:43:01 -08:00