afeldman-nm 19a53b2783

[V1] Decouple GPU and TPU InputBatch (#19778) ...

Signed-off-by: Andrew Feldman <afeldman@redhat.com>

2025-06-18 06:38:13 +00:00

..

__init__.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

block_table.py

[Core] Use tuple for kv cache group block ids (#19175)

2025-06-10 07:01:17 +02:00

cpu_model_runner.py

[CPU] Refine default config for the CPU backend (#19539)

2025-06-13 13:27:39 +08:00

cpu_worker.py

Automatically bind CPU OMP Threads of a rank to CPU ids of a NUMA node. (#17930)

2025-06-10 06:22:05 +00:00

gpu_input_batch.py

[V1] Decouple GPU and TPU InputBatch (#19778)

2025-06-18 06:38:13 +00:00

gpu_model_runner.py

[CUDA] Enable full cudagraph for FlashMLA (#18581)

2025-06-13 18:12:26 +00:00

gpu_worker.py

[Bugfix] Fix TP inference for Flex attention backend (#19657)

2025-06-16 11:21:37 +00:00

lora_model_runner_mixin.py

[V1] Decouple GPU and TPU InputBatch (#19778)

2025-06-18 06:38:13 +00:00

tpu_input_batch.py

[V1] Decouple GPU and TPU InputBatch (#19778)

2025-06-18 06:38:13 +00:00

tpu_model_runner.py

[V1] Decouple GPU and TPU InputBatch (#19778)

2025-06-18 06:38:13 +00:00

tpu_worker.py

[Bugfix] Fix TP inference for Flex attention backend (#19657)

2025-06-16 11:21:37 +00:00

utils.py

[V1] Change return type on get_multimodal_embeddings() (#19446)

2025-06-16 13:32:15 -04:00

worker_base.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00