Vensen 66b5840287

[Bugfix][sleepmode][fp8 kv cache]: Fix FP8 KV cache + sleep(level=2) gibberish output (#28783) ...

Signed-off-by: vensen <vensenmu@gmail.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>

2025-11-30 14:24:25 +08:00

..

basic_correctness

[Bugfix][sleepmode][fp8 kv cache]: Fix FP8 KV cache + sleep(level=2) gibberish output (#28783)

2025-11-30 14:24:25 +08:00

benchmarks

Feature/video support in random mm dataset (#25963)

2025-10-29 18:24:52 +08:00

compile

[Frontend] Remap -O to -cc commandline flag (#29557)

2025-11-28 21:51:12 +00:00

config

[torch.compile] caching of config fields should be opt-out by default (#26468)

2025-11-19 06:13:54 -08:00

cuda

…

detokenizer

…

distributed

[EPLB] Optimize EPLB for Async Rearrange Experts (#22179)

2025-11-24 09:08:29 -05:00

engine

[Frontend] Remap -O to -cc commandline flag (#29557)

2025-11-28 21:51:12 +00:00

entrypoints

[Bugfix] Revert test_tokenization.py (#29729)

2025-11-29 16:35:15 +00:00

evals

Add output token counting to gsm8k eval (#28594)

2025-11-14 09:32:03 +00:00

kernels

[LoRA] Support FusedMoE LoRA Triton kernel for mxfp4 (#29708)

2025-11-30 10:37:25 +08:00

kv_transfer

…

lora

[LoRA] Cleanup LoRA unused code (#29611)

2025-11-28 22:52:58 -08:00

model_executor

[Frontend][torch.compile] CompilationConfig Overhaul (#20283): Set up -O infrastructure (#26847)

2025-11-27 01:55:58 -08:00

models

[Misc] Refactor tokenizer interface (#29693)

2025-11-29 04:02:21 -08:00

multimodal

[Chore] Enable passing tokenizer=None into MM processor (#29724)

2025-11-29 06:25:10 -08:00

plugins

[LoRA] Cleanup LoRA unused code (#29611)

2025-11-28 22:52:58 -08:00

plugins_tests

…

prompts

…

quantization

[Bugfix] Make compressed-tensors MoEs respect ignored layers (#28878)

2025-11-26 21:35:13 -05:00

reasoning

[Misc] Refactor tokenizer interface (#29693)

2025-11-29 04:02:21 -08:00

rocm/aiter

[Bugfix] [ROCm] [AITER]: Fix aiter block quant not compatible with torch compile dynamo (#28716)

2025-11-14 10:30:50 -08:00

samplers

[Core] Switch Flat logprob control from environment variable to SamplingParams (#28914)

2025-11-19 02:10:02 +00:00

standalone_tests

[CI/Build] Move pre-commit only scripts to tools/pre_commit (#27657)

2025-10-29 08:04:33 +00:00

system_messages

…

tokenizers_

[Misc] Refactor tokenizer interface (#29693)

2025-11-29 04:02:21 -08:00

tool_use

[Chore] Move detokenizer_utils to vllm/tokenizers (#29727)

2025-11-29 06:25:17 -08:00

tools

[CI/Build] Move pre-commit only scripts to tools/pre_commit (#27657)

2025-10-29 08:04:33 +00:00

tpu

…

transformers_utils

[Misc] Refactor tokenizer interface (#29693)

2025-11-29 04:02:21 -08:00

utils_

[Chore] Move detokenizer_utils to vllm/tokenizers (#29727)

2025-11-29 06:25:17 -08:00

v1

[Misc] Refactor tokenizer interface (#29693)

2025-11-29 04:02:21 -08:00

vllm_test_utils

…

weight_loading

[ROCm][CI] Fix Weight Loading With Multiple GPU Tests on ROCm (#28984)

2025-11-19 21:31:33 +00:00

__init__.py

…

ci_envs.py

…

conftest.py

hfrunner.classify should return list[list[float]] not list[str] (#29671)

2025-11-29 13:57:00 +00:00

test_config.py

Improve enable chunked_prefill & prefix_caching logic. (#26623)

2025-11-27 22:05:48 -08:00

test_embedded_commit.py

…

test_envs.py

[Misc] fix comment in test_envs (#28529)

2025-11-14 09:32:46 +00:00

test_inputs.py

[Bugfix][Perf] Revert applying HF processor on text-only inputs for multimodal models (#28858)

2025-11-17 14:49:25 +00:00

test_logger.py

[Misc] Colorize logs (#29017)

2025-11-19 19:26:04 -05:00

test_logprobs.py

[Core] Switch Flat logprob control from environment variable to SamplingParams (#28914)

2025-11-19 02:10:02 +00:00

test_outputs.py

…

test_pooling_params.py

[Frontend][Doc][5/N] Improve all pooling task | Polish encode (pooling) api & Document. (#25524)

2025-10-30 12:13:05 +00:00

test_regression.py

…

test_routing_simulator.py

[MoE][Refactor] Make select_experts a non-static method (#29067)

2025-11-24 13:38:04 -05:00

test_scalartype.py

…

test_seed_behavior.py

…

test_sequence.py

…

test_triton_utils.py

…

test_version.py

…

test_vllm_port.py

…

utils.py

[Bugfix][sleepmode][fp8 kv cache]: Fix FP8 KV cache + sleep(level=2) gibberish output (#28783)

2025-11-30 14:24:25 +08:00