Wentao Ye 0b0aa874e8

[Perf] Optimize batch invariant BMM, 18.1% Throughput improvement, 10.7% TTFT improvement (#29345) ...

Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

2025-11-26 09:38:52 -07:00

..

basic_correctness

[Core] Deprecate xformers (#29262)

2025-11-24 04:18:55 +00:00

benchmarks

…

compile

Revert "[Bugfix] Fix GPT-OSS AR+NORM fusion (#28841)" (#29483)

2025-11-26 22:27:26 +08:00

config

[torch.compile] caching of config fields should be opt-out by default (#26468)

2025-11-19 06:13:54 -08:00

cuda

…

detokenizer

…

distributed

[EPLB] Optimize EPLB for Async Rearrange Experts (#22179)

2025-11-24 09:08:29 -05:00

engine

[Bugfix] Fix logic for choosing default prefix caching setting (#29393)

2025-11-25 14:05:10 +00:00

entrypoints

[responsesAPI][2] parse ResponseFunctionToolCallOutputItem (#29383)

2025-11-25 10:27:26 -08:00

evals

Add output token counting to gsm8k eval (#28594)

2025-11-14 09:32:03 +00:00

kernels

[Perf][Deepseek] optimize gather_and_maybe_dequant_cache kernel's perf for extremely long sequence (#28029)

2025-11-24 19:05:46 -07:00

kv_transfer

…

lora

[Core] Deprecate xformers (#29262)

2025-11-24 04:18:55 +00:00

model_executor

[Multimodal][Qwen3 Omni] Make Qwen3 Omni work with audio-in-video inputs in V1 engine. (#27721)

2025-11-24 19:24:37 +00:00

models

Fix TeleChatForCausalLM not register issue (#29473)

2025-11-26 05:15:00 -08:00

multimodal

[Bugfix] Handle broken frames in video loading (#29001)

2025-11-20 04:38:12 +00:00

plugins

[V0 deprecation] Deprecate use_v1 parameter (#28112)

2025-11-12 14:03:52 +00:00

plugins_tests

…

prompts

…

quantization

[torchao] fix safetensors for sharding (#28169)

2025-11-19 16:39:45 -08:00

reasoning

reasoning_content -> reasoning (#27752)

2025-11-08 12:15:08 +00:00

rocm/aiter

[Bugfix] [ROCm] [AITER]: Fix aiter block quant not compatible with torch compile dynamo (#28716)

2025-11-14 10:30:50 -08:00

samplers

[Core] Switch Flat logprob control from environment variable to SamplingParams (#28914)

2025-11-19 02:10:02 +00:00

standalone_tests

…

system_messages

…

tokenization

reasoning_content -> reasoning (#27752)

2025-11-08 12:15:08 +00:00

tool_use

[Frontend] Respect Chat Completion parallel_tool_calls param (#26233)

2025-11-25 09:56:15 +00:00

tools

…

tpu

…

transformers_utils

[Feature]: Improve GGUF loading from HuggingFace user experience like repo_id:quant_type (#29137)

2025-11-25 14:28:53 +00:00

utils_

Scheduled removal of CompilationConfig.use_inductor (#29323)

2025-11-25 12:55:42 +00:00

v1

[Perf] Optimize batch invariant BMM, 18.1% Throughput improvement, 10.7% TTFT improvement (#29345)

2025-11-26 09:38:52 -07:00

vllm_test_utils

…

weight_loading

[ROCm][CI] Fix Weight Loading With Multiple GPU Tests on ROCm (#28984)

2025-11-19 21:31:33 +00:00

__init__.py

…

ci_envs.py

…

conftest.py

[BugFix] Fix chunked prompt logprobs + preemption (#29071)

2025-11-22 16:07:18 -05:00

test_config.py

Update rope_scaling to rope_parameters in preparation for Transformers v5 (#28542)

2025-11-19 09:06:36 -08:00

test_embedded_commit.py

…

test_envs.py

[Misc] fix comment in test_envs (#28529)

2025-11-14 09:32:46 +00:00

test_inputs.py

[Bugfix][Perf] Revert applying HF processor on text-only inputs for multimodal models (#28858)

2025-11-17 14:49:25 +00:00

test_logger.py

[Misc] Colorize logs (#29017)

2025-11-19 19:26:04 -05:00

test_logprobs.py

[Core] Switch Flat logprob control from environment variable to SamplingParams (#28914)

2025-11-19 02:10:02 +00:00

test_outputs.py

…

test_pooling_params.py

…

test_regression.py

…

test_routing_simulator.py

[MoE][Refactor] Make select_experts a non-static method (#29067)

2025-11-24 13:38:04 -05:00

test_scalartype.py

…

test_seed_behavior.py

…

test_sequence.py

…

test_triton_utils.py

…

test_version.py

…

test_vllm_port.py

…

utils.py

[chore] Move the rest of wikimedia url to S3 (#28921)

2025-11-18 09:44:18 -08:00