vllmellm 18093084be

[Misc] Remove unnecessary fallback to prefill-decode attention (#19138) ...

Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>

2025-06-05 16:08:26 +08:00

..

attention

[Misc] Remove unnecessary fallback to prefill-decode attention (#19138)

2025-06-05 16:08:26 +08:00

core

[Bugfix][Nixl] Fix full prefix cache hit bug (#18632)

2025-06-05 02:07:32 +00:00

engine

[Misc] refactor: simplify EngineCoreClient.make_async_mp_client in AsyncLLM (#18817)

2025-06-04 15:37:25 -07:00

executor

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

metrics

Fix ValueError: Missing value for tag key(s): model_name,engine. (#19113)

2025-06-04 17:10:45 +08:00

sample

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

spec_decode

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

structured_output

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

worker

[BugFix][Minor] Fix full cuda graph bug when max_num_seqs < 512 (#19171)

2025-06-05 13:41:25 +08:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

kv_cache_interface.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

outputs.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

request.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

serial_utils.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

utils.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00