Woosuk Kwon 913b8e9569 Merge branch 'main' into woosuk/model-runner-v2

2025-09-20 11:18:35 +00:00

..

gpu

random uuid

2025-09-20 11:17:45 +00:00

__init__.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

block_table.py

[Core] Use CpuGpuBuffer for block table tensors (#24795)

2025-09-16 19:18:06 -07:00

cpu_model_runner.py

[Core] Modify the initialization parameters of the lora manager (#25249)

2025-09-19 18:01:28 +00:00

cpu_worker.py

[Bugfix] Fix sequence parallelism bug when enable pipeline parallelism (#24021)

2025-09-16 04:32:32 +00:00

gpu_input_batch.py

[CORE] Prompt Embeddings Support for v1 Engine (#24278)

2025-09-19 08:03:09 +08:00

gpu_model_runner.py

[Hybrid Allocator] Support full attention with different hidden size (#25101)

2025-09-19 23:43:59 -07:00

gpu_ubatch_wrapper.py

[Core/DBO][1/N] Add Dual-Batch Overlap mechanism to VLLM (#23693)

2025-09-16 12:21:48 -04:00

gpu_worker.py

Merge branch 'main' into woosuk/model-runner-v2

2025-09-20 11:18:35 +00:00

kv_connector_model_runner_mixin.py

[P/D][Nixl] Introduce KVTransferMetrics and aggregation strategy (#22188)

2025-09-19 11:09:14 +00:00

lora_model_runner_mixin.py

[Core] Modify the initialization parameters of the lora manager (#25249)

2025-09-19 18:01:28 +00:00

tpu_input_batch.py

[CORE] Prompt Embeddings Support for v1 Engine (#24278)

2025-09-19 08:03:09 +08:00

tpu_model_runner.py

[Core] Modify the initialization parameters of the lora manager (#25249)

2025-09-19 18:01:28 +00:00

tpu_worker.py

[P/D] Add a shutdown method to the Connector API (#22699)

2025-09-07 23:07:00 -07:00

ubatch_splitting.py

[Core/DBO][1/N] Add Dual-Batch Overlap mechanism to VLLM (#23693)

2025-09-16 12:21:48 -04:00

ubatch_utils.py

[Core/DBO][1/N] Add Dual-Batch Overlap mechanism to VLLM (#23693)

2025-09-16 12:21:48 -04:00

ubatching.py

[Core/DBO][1/N] Add Dual-Batch Overlap mechanism to VLLM (#23693)

2025-09-16 12:21:48 -04:00

utils.py

[Hybrid Allocator] Support full attention with different hidden size (#25101)

2025-09-19 23:43:59 -07:00

worker_base.py

[Docs] Fix warnings in mkdocs build (continued) (#23743)

2025-08-27 17:17:29 +00:00

xpu_model_runner.py

[XPU] Fix xpu model runner call torch.cuda APIs (#25011)

2025-09-17 06:45:25 +00:00

xpu_worker.py

[Doc]: fix typos in Python comments (#24115)

2025-09-02 21:14:07 -07:00