Benjamin Chislett 7e6544c797

[Perf] Parallelize fill_bitmask to accelerate high-throughput guided decoding (#21862) ...

Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>

2025-08-05 19:57:49 -07:00

..

__init__.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

block_table.py

[Attention] Refactor attention metadata builder interface (#20466)

2025-07-17 04:44:25 +00:00

cpu_model_runner.py

[V1] [Hybrid] Validate compatibility of attention backend batch reordering at init time (#21557)

2025-08-02 05:29:40 -07:00

cpu_worker.py

[bugfix] Fix auto thread-binding when world_size > 1 in CPU backend and refactor code (#21032)

2025-07-19 05:13:55 -07:00

gpu_input_batch.py

[Sampler] Support returning all logprobs or logits (#21792)

2025-08-04 03:04:12 -07:00

gpu_model_runner.py

[Perf] Parallelize fill_bitmask to accelerate high-throughput guided decoding (#21862)

2025-08-05 19:57:49 -07:00

gpu_worker.py

[V1] [P/D] Refactor KV Connector Path (#21980)

2025-08-03 04:03:40 -07:00

kv_connector_model_runner_mixin.py

[V0 deprecation][P/D] Deprecate v0 KVConnectorBase code (1/2) (#21785)

2025-08-04 19:11:33 -07:00

lora_model_runner_mixin.py

[V1] Decouple GPU and TPU InputBatch (#19778)

2025-06-18 06:38:13 +00:00

tpu_input_batch.py

Support embedding models in V1 (#16188)

2025-06-18 21:36:33 -07:00

tpu_model_runner.py

[Core] Factor out common logic for MM budget calculation (#22228)

2025-08-04 23:54:55 -07:00

tpu_worker.py

[V1] Get supported tasks from model runner instead of model config (#21585)

2025-07-25 05:36:45 -07:00

utils.py

[Core] Factor out common logic for MM budget calculation (#22228)

2025-08-04 23:54:55 -07:00

worker_base.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

xpu_model_runner.py

[XPU][CI] enhance xpu test support (#20652)

2025-07-09 16:53:09 +00:00

xpu_worker.py

Expose PyTorch profiler configuration to environment variables (#21803)

2025-07-29 19:46:31 -07:00