Benjamin Chislett 304419576a

[Perf] Refactor cudagraph_support to enable full CUDA graphs for spec decoding with FlashInfer (#28479) ...

Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>

2025-11-13 01:56:40 +09:00

..

__init__.py

…

block_table.py

[DCP] Support dcp kv_cache interleave size > 1 (#26696)

2025-11-09 04:45:27 +09:00

cpu_model_runner.py

[CPU] Refactor CPU attention backend (#27954)

2025-11-12 09:43:06 +08:00

cpu_worker.py

[HARDWARE][CPU] Add Option for Disabling Binding to Specific CPU Cores (#27953)

2025-11-06 23:47:11 +08:00

dp_utils.py

[Misc] Replace CUDA_VISIBLE_DEVICES in DP with torch.cuda.set_device for device selection on cuda-like devices (#27564)

2025-10-30 11:41:44 -04:00

ec_connector_model_runner_mixin.py

[Core] Encoder separation for Encode-Prefill-Decode Disaggregation (#25233)

2025-11-11 18:58:33 -08:00

gpu_input_batch.py

[DCP] Support dcp kv_cache interleave size > 1 (#26696)

2025-11-09 04:45:27 +09:00

gpu_model_runner.py

[Perf] Refactor cudagraph_support to enable full CUDA graphs for spec decoding with FlashInfer (#28479)

2025-11-13 01:56:40 +09:00

gpu_ubatch_wrapper.py

[Chore] Separate out optional dependency checks from vllm.utils (#27207)

2025-10-22 10:44:21 -04:00

gpu_worker.py

[Core] Encoder separation for Encode-Prefill-Decode Disaggregation (#25233)

2025-11-11 18:58:33 -08:00

kv_connector_model_runner_mixin.py

…

lora_model_runner_mixin.py

[Bugfix][LoRA][Spec Decode] Support LoRA with speculative decoding (#21068)

2025-11-08 01:58:22 +00:00

tpu_input_batch.py

[Bugfix][LoRA][Spec Decode] Support LoRA with speculative decoding (#21068)

2025-11-08 01:58:22 +00:00

tpu_model_runner.py

[Core][MM] Add mechanism to configure multimodal fields which should stay on CPU (#28168)

2025-11-07 12:14:29 +00:00

tpu_worker.py

[Core] Async scheduling + structured outputs compatibility (#26866)

2025-11-01 00:35:04 +00:00

ubatch_utils.py

…

ubatching.py

[Bug] Fix DBO IMA issue for DeepEPHT (#27666)

2025-10-29 16:28:27 -04:00

utils.py

[Hybrid] Pass kernel block size to builders (#27753)

2025-11-03 05:48:03 +00:00

worker_base.py

[Core] Async scheduling + structured outputs compatibility (#26866)

2025-11-01 00:35:04 +00:00

xpu_model_runner.py

…

xpu_worker.py

…