Bowen Wang e9fd658a73

[Feature] Expert Parallelism Load Balancer (EPLB) (#18343) ...

Signed-off-by: Bowen Wang <abmfy@icloud.com>

2025-06-26 15:30:21 -07:00

..

__init__.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

block_table.py

[Core] Use tuple for kv cache group block ids (#19175)

2025-06-10 07:01:17 +02:00

cpu_model_runner.py

[Bugfix][CPU] Fix InputBatch for pooling models in the CPU v1 (#20014)

2025-06-24 13:20:04 +00:00

cpu_worker.py

Automatically bind CPU OMP Threads of a rank to CPU ids of a NUMA node. (#17930)

2025-06-10 06:22:05 +00:00

gpu_input_batch.py

[Bugfix][v1] Fix step pooler implementation and step pooling usage in v1 (#19956)

2025-06-23 18:38:06 +00:00

gpu_model_runner.py

[Feature] Expert Parallelism Load Balancer (EPLB) (#18343)

2025-06-26 15:30:21 -07:00

gpu_worker.py

[Feature] Expert Parallelism Load Balancer (EPLB) (#18343)

2025-06-26 15:30:21 -07:00

lora_model_runner_mixin.py

[V1] Decouple GPU and TPU InputBatch (#19778)

2025-06-18 06:38:13 +00:00

tpu_input_batch.py

Support embedding models in V1 (#16188)

2025-06-18 21:36:33 -07:00

tpu_model_runner.py

[TPU] add kv cache update kernel (#19928)

2025-06-26 10:01:37 -07:00

tpu_worker.py

[TPU][Bugfix] fix kv cache padding (#20048)

2025-06-25 21:24:10 +00:00

utils.py

[V1] Change return type on get_multimodal_embeddings() (#19446)

2025-06-16 13:32:15 -04:00

worker_base.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

xpu_model_runner.py

[Hardware][Intel GPU] Add v1 Intel GPU support with Flash attention backend. (#19560)

2025-06-26 09:27:18 -07:00

xpu_worker.py

[Hardware][Intel GPU] Add v1 Intel GPU support with Flash attention backend. (#19560)

2025-06-26 09:27:18 -07:00