Benjamin Chislett c30b405b8f

[Spec Decode] Enable FlashInfer Spec Decoding (#25196) ...

Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Co-authored-by: lhsjohn <huashuoli@tencent.com>

2025-09-23 22:29:58 -04:00

..

attention

[Spec Decode] Enable FlashInfer Spec Decoding (#25196)

2025-09-23 22:29:58 -04:00

core

[Core] Use KVCacheBlock as much as possible instead of dict[block_id, KVCacheBlock] (#24830)

2025-09-23 15:11:14 -07:00

cudagraph

[CLI env var] Add VLLM_FLASH_ATTN_MAX_NUM_SPLITS_FOR_CUDA_GRAPH in env variables (#25274)

2025-09-22 10:37:43 -07:00

e2e

[CI] Revert back prepare_prompts and check_answers (#25087)

2025-09-17 11:03:16 -07:00

engine

[V0 Deprecation] Remove async_output_proc, preemption mode, delay factor (#25334)

2025-09-21 08:52:32 -07:00

entrypoints

Improve output when failing json.loads() on structured output test (#25483)

2025-09-23 18:03:31 -06:00

executor

[Doc]: fix typos in Python comments (#24077)

2025-09-02 02:38:55 -07:00

kv_connector

[Docs] NixlConnector quickstart guide (#24249)

2025-09-23 14:23:22 +00:00

kv_offload

[KV offload][5/N] Add CPUOffloadingSpec (#24251)

2025-09-22 12:30:36 -07:00

logits_processors

[V1] Logits processor docs (#22919)

2025-09-17 11:53:12 -07:00

metrics

[Misc] Have AsyncLLM custom_stat_loggers extend default logger list (#20952)

2025-09-04 14:25:30 -07:00

sample

Move ModelConfig from config/__init__.py to config/model.py (#25252)

2025-09-19 16:22:33 +00:00

shutdown

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

spec_decode

[Speculators][Speculative Decoding] Fix gpt-oss eagle3 accuracy issue (#25406)

2025-09-23 15:44:35 -04:00

structured_output

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

tpu

[TPU] Deprecate xm.mark_step in favor of `torch_xla.sync (#25254)

2025-09-22 10:12:57 +00:00

tracing

[V0 Deprecation] Remove V0 Tracing & Metrics tests (#25115)

2025-09-17 19:40:44 -07:00

worker

[BugFix] Fix OOM in vLLM replicas by ensuring consistent NCCL memory accounting (#25359)

2025-09-23 15:49:09 -07:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

test_async_llm_dp.py

[V0 deprecation] Remove platform v1 controling interface (#25410)

2025-09-23 01:48:12 +00:00

test_external_lb_dp.py

[Frontend] Pass API server count to each process (#23717)

2025-09-20 01:15:19 +08:00

test_hybrid_lb_dp.py

[Frontend] Pass API server count to each process (#23717)

2025-09-20 01:15:19 +08:00

test_internal_lb_dp.py

[Frontend] Pass API server count to each process (#23717)

2025-09-20 01:15:19 +08:00

test_kv_sharing.py

[Doc]: fix typos in Python comments (#24077)

2025-09-02 02:38:55 -07:00

test_metrics_reader.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_oracle.py

[V0 Deprecation] Remove async_output_proc, preemption mode, delay factor (#25334)

2025-09-21 08:52:32 -07:00

test_request.py

[Misc] Add SPDX-FileCopyrightText (#20428)

2025-07-04 07:40:42 +00:00

test_serial_utils.py

[Refactor] Define MultiModalKwargsItems separate from MultiModalKwargs (#23053)

2025-08-18 09:52:00 +00:00

test_utils.py

Support encoder-only models without KV-Cache (#21270)

2025-07-26 21:09:52 +08:00