Yong Hoon Shin 9324e10275

Fix KV sharing fast prefill with cudagraph enabled (#28537) ...

Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

2025-11-14 11:53:42 +00:00

..

basic_correctness

[Core][AMD] Migrate fully transparent sleep mode to ROCm platform (#12695)

2025-11-12 15:24:12 -08:00

benchmarks

Feature/video support in random mm dataset (#25963)

2025-10-29 18:24:52 +08:00

compile

[Minor] avoid register new custom and just import silly_attn (#28578)

2025-11-14 09:32:31 +00:00

config

[Attention] Refactor CUDA attention backend selection logic (#24794)

2025-11-11 07:40:44 -05:00

cuda

…

detokenizer

…

distributed

[DCP] Support Decode Context Parallel (DCP) for GQA with Flashinfer (#25438)

2025-11-14 11:24:10 +00:00

engine

[Chore]:Extract math and argparse utilities to separate modules (#27188)

2025-10-26 04:03:32 -07:00

entrypoints

[Frontend] Added chat-style multimodal support to /classify. (#27516)

2025-11-14 11:03:55 +00:00

evals

Add output token counting to gsm8k eval (#28594)

2025-11-14 09:32:03 +00:00

kernels

[Performance][B200] silu_mul_quant: pack scales in int32 (#28358)

2025-11-13 10:16:55 -08:00

kv_transfer

…

lora

[CI] lora/test_mixtral.py : Add additional expected outputs due to flakiness (#28322)

2025-11-10 10:45:29 +08:00

model_executor

[RFC][ROCm][AITER] Keep all AITER kernels in _aiter_ops class like _custom_ops and _ipex_ops (#24490)

2025-11-10 08:20:53 -08:00

models

[Misc] Turn off encoder torch compile by default (#28634)

2025-11-13 08:38:08 -08:00

multimodal

…

plugins

[V0 deprecation] Deprecate use_v1 parameter (#28112)

2025-11-12 14:03:52 +00:00

plugins_tests

…

prompts

…

quantization

[quantization][config] enable override existing quant_config (#28510)

2025-11-14 01:24:10 +00:00

reasoning

reasoning_content -> reasoning (#27752)

2025-11-08 12:15:08 +00:00

samplers

[Misc] FlattenLogprobs -> FlatLogprobs (#28335)

2025-11-11 03:41:23 +00:00

standalone_tests

[CI/Build] Move pre-commit only scripts to tools/pre_commit (#27657)

2025-10-29 08:04:33 +00:00

system_messages

…

tokenization

reasoning_content -> reasoning (#27752)

2025-11-08 12:15:08 +00:00

tool_use

reasoning_content -> reasoning (#27752)

2025-11-08 12:15:08 +00:00

tools

[CI/Build] Move pre-commit only scripts to tools/pre_commit (#27657)

2025-10-29 08:04:33 +00:00

tpu

…

transformers_utils

Speed up mm processor kwargs per request by spliting dynamic and static kwargs (#26483)

2025-11-07 07:51:28 +08:00

utils_

[Frontend] Change CompilationMode to a proper Enum (#28165)

2025-11-11 19:46:18 -05:00

v1

Fix KV sharing fast prefill with cudagraph enabled (#28537)

2025-11-14 11:53:42 +00:00

vllm_test_utils

…

weight_loading

…

__init__.py

…

ci_envs.py

…

conftest.py

[Performance][B200] silu_mul_quant: pack scales in int32 (#28358)

2025-11-13 10:16:55 -08:00

test_config.py

…

test_embedded_commit.py

…

test_envs.py

[Misc] fix comment in test_envs (#28529)

2025-11-14 09:32:46 +00:00

test_inputs.py

…

test_logger.py

…

test_logprobs.py

[Misc] FlattenLogprobs -> FlatLogprobs (#28335)

2025-11-11 03:41:23 +00:00

test_outputs.py

…

test_pooling_params.py

[Frontend][Doc][5/N] Improve all pooling task | Polish encode (pooling) api & Document. (#25524)

2025-10-30 12:13:05 +00:00

test_regression.py

…

test_routing_simulator.py

…

test_scalartype.py

…

test_seed_behavior.py

…

test_sequence.py

…

test_triton_utils.py

…

test_version.py

…

test_vllm_port.py

…

utils.py

Adds anthropic /v1/messages endpoint to openai api_server (#27882)

2025-11-01 12:45:42 -07:00