Lucas Wilkinson 48fc8b1e59

[BugFix] Fix async-scheduling + FlashAttn MLA (#28990) ...

Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>

2025-11-19 10:04:07 -05:00

..

__init__.py

…

block_table.py

[Bugfix][Nixl] Fix kernel physical<>logical block_size issue (#28677)

2025-11-14 22:40:05 +08:00

cpu_model_runner.py

Replace torch.cuda.Event with torch.Event for better hardware compatibility (#26985)

2025-11-18 11:34:36 -08:00

cpu_worker.py

[HARDWARE][CPU] Add Option for Disabling Binding to Specific CPU Cores (#27953)

2025-11-06 23:47:11 +08:00

dp_utils.py

[Misc] Replace CUDA_VISIBLE_DEVICES in DP with torch.cuda.set_device for device selection on cuda-like devices (#27564)

2025-10-30 11:41:44 -04:00

ec_connector_model_runner_mixin.py

[Core] Encoder separation for Encode-Prefill-Decode Disaggregation (#25233)

2025-11-11 18:58:33 -08:00

gpu_input_batch.py

Replace torch.cuda.Event with torch.Event for better hardware compatibility (#26985)

2025-11-18 11:34:36 -08:00

gpu_model_runner.py

[BugFix] Fix async-scheduling + FlashAttn MLA (#28990)

2025-11-19 10:04:07 -05:00

gpu_ubatch_wrapper.py

…

gpu_worker.py

[BugFix] Fix PP performance and PP kv connector output regression (#28768)

2025-11-17 14:08:50 -08:00

kv_connector_model_runner_mixin.py

…

lora_model_runner_mixin.py

[Bugfix][LoRA][Spec Decode] Support LoRA with speculative decoding (#21068)

2025-11-08 01:58:22 +00:00

tpu_input_batch.py

[Bugfix][LoRA][Spec Decode] Support LoRA with speculative decoding (#21068)

2025-11-08 01:58:22 +00:00

tpu_model_runner.py

[Redo] #26368 (#28771)

2025-11-14 22:47:41 -08:00

tpu_worker.py

[Core] Async scheduling + structured outputs compatibility (#26866)

2025-11-01 00:35:04 +00:00

ubatch_utils.py

…

ubatching.py

Replace torch.cuda.Event with torch.Event for better hardware compatibility (#26985)

2025-11-18 11:34:36 -08:00

utils.py

Rename clashing method names for vLLM model protocol (#27583)

2025-11-12 19:14:33 -08:00

worker_base.py

[V1] Support MP Executor for multi node distributed inference (#23691)

2025-11-16 09:01:21 +00:00

xpu_model_runner.py

Replace torch.cuda.Event with torch.Event for better hardware compatibility (#26985)

2025-11-18 11:34:36 -08:00

xpu_worker.py

use default CCL_ZE_IPC_EXCHANGE (#28700)

2025-11-14 16:55:29 +08:00