Divakar Verma 774c5fde30

[V1] fix torch profiling for V1 offline scenarios (#18445) ...

Signed-off-by: Divakar Verma <divakar.verma@amd.com>

2025-05-28 04:16:30 +00:00

..

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

cache_engine.py

Allocate kv_cache with stride order (#16605)

2025-04-25 22:03:31 -07:00

cpu_enc_dec_model_runner.py

[Core] Automatically cast multi-modal input dtype (#18756)

2025-05-27 23:45:48 +08:00

cpu_model_runner.py

[Core] Automatically cast multi-modal input dtype (#18756)

2025-05-27 23:45:48 +08:00

cpu_pooling_model_runner.py

[Core] Automatically cast multi-modal input dtype (#18756)

2025-05-27 23:45:48 +08:00

cpu_worker.py

Refactor pplx init logic to make it modular (prepare for deepep) (#18200)

2025-05-23 23:43:43 +08:00

enc_dec_model_runner.py

[Core] Automatically cast multi-modal input dtype (#18756)

2025-05-27 23:45:48 +08:00

hpu_model_runner.py

cleanup invalid prints (#18050)

2025-05-12 23:01:57 -07:00

hpu_worker.py

Refactor pplx init logic to make it modular (prepare for deepep) (#18200)

2025-05-23 23:43:43 +08:00

model_runner_base.py

[Bugfix] Do not crash V0 engine on input errors (#13101)

2025-02-26 19:07:29 +08:00

model_runner.py

[Core] Automatically cast multi-modal input dtype (#18756)

2025-05-27 23:45:48 +08:00

multi_step_hpu_worker.py

[Hardware][Intel-Gaudi] Multi-step scheduling implementation for HPU (#12779)

2025-04-11 07:38:36 -07:00

multi_step_model_runner.py

[Doc] Convert Sphinx directives ( {class}, {meth}, {attr}, ...) to MkDocs format for better documentation linking (#18663)

2025-05-27 01:44:20 -07:00

multi_step_neuron_model_runner.py

[Core] Automatically cast multi-modal input dtype (#18756)

2025-05-27 23:45:48 +08:00

multi_step_neuronx_distributed_model_runner.py

[Core] Automatically cast multi-modal input dtype (#18756)

2025-05-27 23:45:48 +08:00

multi_step_tpu_worker.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

multi_step_worker.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

neuron_model_runner.py

[Core] Automatically cast multi-modal input dtype (#18756)

2025-05-27 23:45:48 +08:00

neuron_worker.py

Add NeuronxDistributedInference support, Speculative Decoding, Dynamic on-device sampling (#16357)

2025-05-07 00:07:30 -07:00

neuronx_distributed_model_runner.py

Add NeuronxDistributedInference support, Speculative Decoding, Dynamic on-device sampling (#16357)

2025-05-07 00:07:30 -07:00

pooling_model_runner.py

[Core] Automatically cast multi-modal input dtype (#18756)

2025-05-27 23:45:48 +08:00

tpu_model_runner.py

Change top_k to be disabled with 0 (still accept -1 for now) (#17773)

2025-05-09 10:01:49 +00:00

tpu_worker.py

Refactor pplx init logic to make it modular (prepare for deepep) (#18200)

2025-05-23 23:43:43 +08:00

utils.py

[Doc] Update references to doc files (#18637)

2025-05-23 15:49:21 -07:00

worker_base.py

[RLHF] use worker_extension_cls for compatibility with V0 and V1 (#14185)

2025-03-07 00:32:46 +08:00

worker.py

[V1] fix torch profiling for V1 offline scenarios (#18445)

2025-05-28 04:16:30 +00:00

xpu_model_runner.py

[Core] Automatically cast multi-modal input dtype (#18756)

2025-05-27 23:45:48 +08:00

xpu_worker.py

Refactor pplx init logic to make it modular (prepare for deepep) (#18200)

2025-05-23 23:43:43 +08:00