Wentao Ye 17eb25e327

[Perf] Enable cuda graph for deepepHT, 5.3% throughput improvement, 4.4% TTFT improvement (#29558) ...

Signed-off-by: yewentao256 <zhyanwentao@126.com>

2025-12-07 04:44:50 +00:00

..

basic_correctness

[ROCm][CI] Increase the memory threshold for test_deep_sleep_fp8_kvcache (#30104)

2025-12-05 04:51:44 +00:00

benchmarks

Fix boolean nested params, add dict format support, and enhance plotting for vllm bench sweep (#29025)

2025-12-02 20:40:56 +00:00

compile

[Perf] Enable cuda graph for deepepHT, 5.3% throughput improvement, 4.4% TTFT improvement (#29558)

2025-12-07 04:44:50 +00:00

config

[torch.compile] caching of config fields should be opt-out by default (#26468)

2025-11-19 06:13:54 -08:00

cuda

…

detokenizer

…

distributed

[Model] Move multimodal_cpu_fields definition to field config (#30181)

2025-12-06 13:40:02 +00:00

engine

[Frontend] Remap -O to -cc commandline flag (#29557)

2025-11-28 21:51:12 +00:00

entrypoints

Support multiple image/audio embeddings per requests (#29988)

2025-12-07 04:34:24 +00:00

evals

…

kernels

[CI/Build][AMD] Skip marlin, machete, and hadacore tests since these require _C functions not defined for ROCm (#30109)

2025-12-06 12:54:17 +08:00

lora

Remove default values from InitVars so that they're not stored (#29859)

2025-12-02 12:16:37 +00:00

model_executor

Validating Runai Model Streamer Integration with S3 Object Storage (#29320)

2025-12-04 18:04:43 +08:00

models

Support tokenization_kwargs override (#29794)

2025-12-06 09:12:53 +00:00

multimodal

[Model] Move multimodal_cpu_fields definition to field config (#30181)

2025-12-06 13:40:02 +00:00

plugins

[Frontend] Resettle pooling entrypoints (#29634)

2025-12-01 15:30:43 +08:00

plugins_tests

[Frontend] Resettle pooling entrypoints (#29634)

2025-12-01 15:30:43 +08:00

prompts

…

quantization

[Bugfix] Make compressed-tensors MoEs respect ignored layers (#28878)

2025-11-26 21:35:13 -05:00

reasoning

[Model] Add Holo2 reasoning parser (#30048)

2025-12-05 10:38:45 +08:00

rocm/aiter

…

samplers

[Core] Switch Flat logprob control from environment variable to SamplingParams (#28914)

2025-11-19 02:10:02 +00:00

standalone_tests

[CI] fix docker image build by specifying merge-base commit id when downloading pre-compiled wheels (#29930)

2025-12-03 14:08:19 -08:00

system_messages

…

tokenizers_

Add Mistral Large 3 and Ministral 3 (#29757)

2025-12-02 10:29:00 +00:00

tool_use

[Bugfix] Mistral tool parser streaming update (#19425)

2025-12-03 17:45:31 +00:00

tools

…

tpu

…

transformers_utils

[Chore]: Reorganize gguf utils funtions under transformers_utils (#29891)

2025-12-02 17:33:23 +00:00

utils_

[Frontend] Remove confusing -O.xx flag error (#30169)

2025-12-07 02:53:42 +00:00

v1

[Model] Move multimodal_cpu_fields definition to field config (#30181)

2025-12-06 13:40:02 +00:00

vllm_test_utils

…

weight_loading

[ROCm][CI] Fix Weight Loading With Multiple GPU Tests on ROCm (#28984)

2025-11-19 21:31:33 +00:00

__init__.py

…

ci_envs.py

…

conftest.py

Support tokenization_kwargs override (#29794)

2025-12-06 09:12:53 +00:00

test_config.py

[Model][6/N] Improve all pooling task | Support chunked prefill with ALL pooling (#27145)

2025-12-04 13:44:15 +00:00

test_embedded_commit.py

…

test_envs.py

[Bugfix] Respect VLLM_CONFIGURE_LOGGING value (#28671)

2025-12-03 22:00:52 +00:00

test_inputs.py

[Chore] Move tokenizer initialization methods (#29793)

2025-12-02 13:33:37 +08:00

test_logger.py

[BugFix] respect VLLM_LOGGING_LEVEL in logger (#29761)

2025-12-02 07:49:16 +00:00

test_logprobs.py

[Core] Switch Flat logprob control from environment variable to SamplingParams (#28914)

2025-11-19 02:10:02 +00:00

test_outputs.py

…

test_pooling_params.py

…

test_regression.py

…

test_routing_simulator.py

[MoE][Refactor] Make select_experts a non-static method (#29067)

2025-11-24 13:38:04 -05:00

test_scalartype.py

…

test_seed_behavior.py

…

test_sequence.py

…

test_triton_utils.py

…

test_version.py

…

test_vllm_port.py

…

utils.py

[Chore] Move tokenizer initialization methods (#29793)

2025-12-02 13:33:37 +08:00