Jay Caldwell 6f37419244

[Bugfix][Model] Prevent special token leakage in KimiK2ToolParser streaming mode (#28543) ...

Signed-off-by: Jscaldwell55 <jay.s.caldwell@gmail.com>

2025-11-17 13:54:46 +08:00

..

basic_correctness

[Core][AMD] Migrate fully transparent sleep mode to ROCm platform (#12695)

2025-11-12 15:24:12 -08:00

benchmarks

Feature/video support in random mm dataset (#25963)

2025-10-29 18:24:52 +08:00

compile

[compile] Enable sequence parallelism matching w/o custom ops enabled (#27126)

2025-11-15 11:46:12 +00:00

config

[Attention] Refactor CUDA attention backend selection logic (#24794)

2025-11-11 07:40:44 -05:00

cuda

…

detokenizer

…

distributed

[V1] Support MP Executor for multi node distributed inference (#23691)

2025-11-16 09:01:21 +00:00

engine

[Chore]:Extract math and argparse utilities to separate modules (#27188)

2025-10-26 04:03:32 -07:00

entrypoints

[DisaggEverything] Tokens in<>out /generate endpoint (#24261)

2025-11-14 09:58:01 -07:00

evals

Add output token counting to gsm8k eval (#28594)

2025-11-14 09:32:03 +00:00

kernels

Feature: Support Relu2 in FusedMoE fp8 cutlass path (#27261)

2025-11-16 13:39:44 -05:00

kv_transfer

…

lora

[CI] lora/test_mixtral.py : Add additional expected outputs due to flakiness (#28322)

2025-11-10 10:45:29 +08:00

model_executor

[RFC][ROCm][AITER] Keep all AITER kernels in _aiter_ops class like _custom_ops and _ipex_ops (#24490)

2025-11-10 08:20:53 -08:00

models

[Model] Allow users to control skip reading cache per request. (#28194)

2025-11-16 00:04:50 -08:00

multimodal

…

plugins

[V0 deprecation] Deprecate use_v1 parameter (#28112)

2025-11-12 14:03:52 +00:00

plugins_tests

[Frontend][4/N] Improve all pooling task | Add plugin pooling task (#26973)

2025-10-23 14:46:18 +00:00

prompts

…

quantization

[quantization][config] enable override existing quant_config (#28510)

2025-11-14 01:24:10 +00:00

reasoning

reasoning_content -> reasoning (#27752)

2025-11-08 12:15:08 +00:00

rocm/aiter

[Bugfix] [ROCm] [AITER]: Fix aiter block quant not compatible with torch compile dynamo (#28716)

2025-11-14 10:30:50 -08:00

samplers

[Misc] FlattenLogprobs -> FlatLogprobs (#28335)

2025-11-11 03:41:23 +00:00

standalone_tests

[CI/Build] Move pre-commit only scripts to tools/pre_commit (#27657)

2025-10-29 08:04:33 +00:00

system_messages

…

tokenization

reasoning_content -> reasoning (#27752)

2025-11-08 12:15:08 +00:00

tool_use

[Bugfix][Model] Prevent special token leakage in KimiK2ToolParser streaming mode (#28543)

2025-11-17 13:54:46 +08:00

tools

[CI/Build] Move pre-commit only scripts to tools/pre_commit (#27657)

2025-10-29 08:04:33 +00:00

tpu

[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change compilation level to compilation mode, deprecation compilation level (#26355)

2025-10-15 02:51:16 +00:00

transformers_utils

Speed up mm processor kwargs per request by spliting dynamic and static kwargs (#26483)

2025-11-07 07:51:28 +08:00

utils_

[Frontend] Change CompilationMode to a proper Enum (#28165)

2025-11-11 19:46:18 -05:00

v1

[BugFix] Fix async scheduling + chunked prefill + preemption (#28787)

2025-11-17 06:46:46 +08:00

vllm_test_utils

…

weight_loading

…

__init__.py

…

ci_envs.py

[Model][0/N] Improve all pooling task | clean up (#25817)

2025-10-13 16:44:50 +08:00

conftest.py

[Performance][B200] silu_mul_quant: pack scales in int32 (#28358)

2025-11-13 10:16:55 -08:00

test_config.py

…

test_embedded_commit.py

…

test_envs.py

[Misc] fix comment in test_envs (#28529)

2025-11-14 09:32:46 +00:00

test_inputs.py

…

test_logger.py

[torch.compile] Enable attention and allreduce fusion without custom ops enabled (#24604)

2025-10-17 08:10:23 -06:00

test_logprobs.py

[Misc] FlattenLogprobs -> FlatLogprobs (#28335)

2025-11-11 03:41:23 +00:00

test_outputs.py

…

test_pooling_params.py

[Frontend][Doc][5/N] Improve all pooling task | Polish encode (pooling) api & Document. (#25524)

2025-10-30 12:13:05 +00:00

test_regression.py

…

test_routing_simulator.py

…

test_scalartype.py

…

test_seed_behavior.py

…

test_sequence.py

…

test_triton_utils.py

…

test_version.py

…

test_vllm_port.py

…

utils.py

Adds anthropic /v1/messages endpoint to openai api_server (#27882)

2025-11-01 12:45:42 -07:00