Jialin Ouyang 4228be7959

[Perf] Use np.ndarray instead of list[list[int]] to reduce GC overhead (#28245) ...

Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>

2025-11-11 10:28:47 -08:00

..

basic_correctness

[Fix] Skip record_sleep_state logic in PrometheusStatsLogger if not in dev mode (#27789)

2025-10-30 19:26:27 +00:00

benchmarks

Feature/video support in random mm dataset (#25963)

2025-10-29 18:24:52 +08:00

compile

[Kernel][Perf] fuse QK Norm and RoPE into one cuda kernel for Qwen Model (#27165)

2025-11-11 12:00:31 -05:00

config

[Attention] Refactor CUDA attention backend selection logic (#24794)

2025-11-11 07:40:44 -05:00

cuda

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

detokenizer

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

distributed

[CI/Test Fix] Fix CP tests on Blackwell (#28404)

2025-11-11 01:36:29 +00:00

engine

[Chore]:Extract math and argparse utilities to separate modules (#27188)

2025-10-26 04:03:32 -07:00

entrypoints

[Frontend] Add sagemaker_standards dynamic lora adapter and stateful session management decorators to vLLM OpenAI API server (#27892)

2025-11-11 04:57:01 +00:00

evals

[Bugfix] Fix Stream Sync for Shared Expert Overlap (#28430)

2025-11-11 05:59:08 +00:00

kernels

[CI/Build] Refactor Attention backend for test_prefix_prefill from xformers to SDPA (#28424)

2025-11-12 01:09:47 +08:00

kv_transfer

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

lora

[CI] lora/test_mixtral.py : Add additional expected outputs due to flakiness (#28322)

2025-11-10 10:45:29 +08:00

model_executor

[RFC][ROCm][AITER] Keep all AITER kernels in _aiter_ops class like _custom_ops and _ipex_ops (#24490)

2025-11-10 08:20:53 -08:00

models

[Quantization] fix attention quantization of gpt_oss model (#27334)

2025-11-11 12:06:00 -05:00

multimodal

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

plugins

[Frontend][4/N] Improve all pooling task | Add plugin pooling task (#26973)

2025-10-23 14:46:18 +00:00

plugins_tests

[Frontend][4/N] Improve all pooling task | Add plugin pooling task (#26973)

2025-10-23 14:46:18 +00:00

prompts

…

quantization

[ROCm][Quantization] extend AMD Quark to support mixed-precision quantized model (#24239)

2025-11-11 12:05:22 -05:00

reasoning

reasoning_content -> reasoning (#27752)

2025-11-08 12:15:08 +00:00

samplers

[Misc] FlattenLogprobs -> FlatLogprobs (#28335)

2025-11-11 03:41:23 +00:00

standalone_tests

[CI/Build] Move pre-commit only scripts to tools/pre_commit (#27657)

2025-10-29 08:04:33 +00:00

system_messages

…

tokenization

reasoning_content -> reasoning (#27752)

2025-11-08 12:15:08 +00:00

tool_use

reasoning_content -> reasoning (#27752)

2025-11-08 12:15:08 +00:00

tools

[CI/Build] Move pre-commit only scripts to tools/pre_commit (#27657)

2025-10-29 08:04:33 +00:00

tpu

[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change compilation level to compilation mode, deprecation compilation level (#26355)

2025-10-15 02:51:16 +00:00

transformers_utils

Speed up mm processor kwargs per request by spliting dynamic and static kwargs (#26483)

2025-11-07 07:51:28 +08:00

utils_

[Misc] Clean up utils (#27552)

2025-10-27 09:05:40 +00:00

v1

[Perf] Use np.ndarray instead of list[list[int]] to reduce GC overhead (#28245)

2025-11-11 10:28:47 -08:00

vllm_test_utils

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

weight_loading

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

__init__.py

…

ci_envs.py

[Model][0/N] Improve all pooling task | clean up (#25817)

2025-10-13 16:44:50 +08:00

conftest.py

[V0 deprecation] Remove VLLM_USE_V1 usage in most modules (#27955)

2025-11-04 20:51:16 -08:00

test_config.py

[UX] Support nested dicts in hf_overrides (#25727)

2025-10-07 11:19:16 +08:00

test_embedded_commit.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_envs.py

[Frontend] [gpt-oss] Mcp type bug (#27689)

2025-10-29 10:01:32 +00:00

test_inputs.py

[Bugfix] Fix SHM cache initialization (#26427)

2025-10-09 02:48:04 -07:00

test_logger.py

[torch.compile] Enable attention and allreduce fusion without custom ops enabled (#24604)

2025-10-17 08:10:23 -06:00

test_logprobs.py

[Misc] FlattenLogprobs -> FlatLogprobs (#28335)

2025-11-11 03:41:23 +00:00

test_outputs.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_pooling_params.py

[Frontend][Doc][5/N] Improve all pooling task | Polish encode (pooling) api & Document. (#25524)

2025-10-30 12:13:05 +00:00

test_regression.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_routing_simulator.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_scalartype.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_seed_behavior.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_sequence.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_triton_utils.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_version.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_vllm_port.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

utils.py

Adds anthropic /v1/messages endpoint to openai api_server (#27882)

2025-11-01 12:45:42 -07:00