Isotr0py 1173804dca

[Bugfix] Fix TP inference for Flex attention backend (#19657) ...

Signed-off-by: Isotr0py <2037008807@qq.com>

2025-06-16 11:21:37 +00:00

..

__init__.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

block_table.py

[Core] Use tuple for kv cache group block ids (#19175)

2025-06-10 07:01:17 +02:00

cpu_model_runner.py

[CPU] Refine default config for the CPU backend (#19539)

2025-06-13 13:27:39 +08:00

cpu_worker.py

Automatically bind CPU OMP Threads of a rank to CPU ids of a NUMA node. (#17930)

2025-06-10 06:22:05 +00:00

gpu_input_batch.py

[Core] Use tuple for kv cache group block ids (#19175)

2025-06-10 07:01:17 +02:00

gpu_model_runner.py

[CUDA] Enable full cudagraph for FlashMLA (#18581)

2025-06-13 18:12:26 +00:00

gpu_worker.py

[Bugfix] Fix TP inference for Flex attention backend (#19657)

2025-06-16 11:21:37 +00:00

lora_model_runner_mixin.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

tpu_model_runner.py

[Fix] The zip function in Python 3.9 does not have the strict argument (#19549)

2025-06-13 14:57:48 +08:00

tpu_worker.py

[Bugfix] Fix TP inference for Flex attention backend (#19657)

2025-06-16 11:21:37 +00:00

utils.py

[V1] Support cross-layer KV sharing (#18212)

2025-06-03 20:33:07 +00:00

worker_base.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00