KazusatoOoko fd48d99ffd

[BugFix]: Batch generation from prompt_embeds fails for long prompts (#21390) ...

Signed-off-by: KazusatoOko <kazusto.oko@sakana.ai>
Co-authored-by: KazusatoOko <kazusto.oko@sakana.ai>

2025-07-23 20:43:17 -07:00

..

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

cache_engine.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

enc_dec_model_runner.py

[V0 Deprecation] Remove Prompt Adapters (#20588)

2025-07-23 16:36:48 -07:00

model_runner_base.py

[V0 Deprecation] Remove Prompt Adapters (#20588)

2025-07-23 16:36:48 -07:00

model_runner.py

[BugFix]: Batch generation from prompt_embeds fails for long prompts (#21390)

2025-07-23 20:43:17 -07:00

multi_step_model_runner.py

[V0 Deprecation] Remove Prompt Adapters (#20588)

2025-07-23 16:36:48 -07:00

multi_step_neuron_model_runner.py

[Core] Cast multimodal input in hf processor (#18862)

2025-06-03 20:24:56 -07:00

multi_step_neuronx_distributed_model_runner.py

[Core] Cast multimodal input in hf processor (#18862)

2025-06-03 20:24:56 -07:00

multi_step_worker.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

neuron_model_runner.py

[Core] Cast multimodal input in hf processor (#18862)

2025-06-03 20:24:56 -07:00

neuron_worker.py

[Refactor]Abstract Platform Interface for Distributed Backend and Add xccl Support for Intel XPU (#19410)

2025-07-07 04:32:32 +00:00

neuronx_distributed_model_runner.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

pooling_model_runner.py

[V0 Deprecation] Remove Prompt Adapters (#20588)

2025-07-23 16:36:48 -07:00

utils.py

[V0 Deprecation] Remove Prompt Adapters (#20588)

2025-07-23 16:36:48 -07:00

worker_base.py

[V0 Deprecation] Remove Prompt Adapters (#20588)

2025-07-23 16:36:48 -07:00

worker.py

[V0 Deprecation] Remove Prompt Adapters (#20588)

2025-07-23 16:36:48 -07:00