Jialin Ouyang 186352b270

[Core] Performance: Use list[np.ndarray] instead of list[list[int]] for output tokens for GC optimization (#26368) ...

Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>

2025-11-14 16:04:04 -08:00

..

basic_correctness

[Core][AMD] Migrate fully transparent sleep mode to ROCm platform (#12695)

2025-11-12 15:24:12 -08:00

benchmarks

Feature/video support in random mm dataset (#25963)

2025-10-29 18:24:52 +08:00

compile

Avoid bytecode hook and simplify TorchCompileWrapperWithCustomDipatch (#25110)

2025-11-14 14:11:10 -08:00

config

[Attention] Refactor CUDA attention backend selection logic (#24794)

2025-11-11 07:40:44 -05:00

cuda

…

detokenizer

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

distributed

[DCP] Support Decode Context Parallel (DCP) for GQA with Flashinfer (#25438)

2025-11-14 11:24:10 +00:00

engine

[Chore]:Extract math and argparse utilities to separate modules (#27188)

2025-10-26 04:03:32 -07:00

entrypoints

[DisaggEverything] Tokens in<>out /generate endpoint (#24261)

2025-11-14 09:58:01 -07:00

evals

Add output token counting to gsm8k eval (#28594)

2025-11-14 09:32:03 +00:00

kernels

[BugFix] Fix FA3 IMA with FULL_AND_PIECEWISE and cascade attention (default) (#28702)

2025-11-14 12:19:22 +00:00

kv_transfer

…

lora

[CI] lora/test_mixtral.py : Add additional expected outputs due to flakiness (#28322)

2025-11-10 10:45:29 +08:00

model_executor

[RFC][ROCm][AITER] Keep all AITER kernels in _aiter_ops class like _custom_ops and _ipex_ops (#24490)

2025-11-10 08:20:53 -08:00

models

Avoid bytecode hook and simplify TorchCompileWrapperWithCustomDipatch (#25110)

2025-11-14 14:11:10 -08:00

multimodal

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

plugins

[V0 deprecation] Deprecate use_v1 parameter (#28112)

2025-11-12 14:03:52 +00:00

plugins_tests

[Frontend][4/N] Improve all pooling task | Add plugin pooling task (#26973)

2025-10-23 14:46:18 +00:00

prompts

…

quantization

[quantization][config] enable override existing quant_config (#28510)

2025-11-14 01:24:10 +00:00

reasoning

reasoning_content -> reasoning (#27752)

2025-11-08 12:15:08 +00:00

rocm/aiter

[Bugfix] [ROCm] [AITER]: Fix aiter block quant not compatible with torch compile dynamo (#28716)

2025-11-14 10:30:50 -08:00

samplers

[Misc] FlattenLogprobs -> FlatLogprobs (#28335)

2025-11-11 03:41:23 +00:00

standalone_tests

[CI/Build] Move pre-commit only scripts to tools/pre_commit (#27657)

2025-10-29 08:04:33 +00:00

system_messages

…

tokenization

reasoning_content -> reasoning (#27752)

2025-11-08 12:15:08 +00:00

tool_use

reasoning_content -> reasoning (#27752)

2025-11-08 12:15:08 +00:00

tools

[CI/Build] Move pre-commit only scripts to tools/pre_commit (#27657)

2025-10-29 08:04:33 +00:00

tpu

[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change compilation level to compilation mode, deprecation compilation level (#26355)

2025-10-15 02:51:16 +00:00

transformers_utils

Speed up mm processor kwargs per request by spliting dynamic and static kwargs (#26483)

2025-11-07 07:51:28 +08:00

utils_

[Frontend] Change CompilationMode to a proper Enum (#28165)

2025-11-11 19:46:18 -05:00

v1

[Core] Performance: Use list[np.ndarray] instead of list[list[int]] for output tokens for GC optimization (#26368)

2025-11-14 16:04:04 -08:00

vllm_test_utils

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

weight_loading

…

__init__.py

…

ci_envs.py

[Model][0/N] Improve all pooling task | clean up (#25817)

2025-10-13 16:44:50 +08:00

conftest.py

[Performance][B200] silu_mul_quant: pack scales in int32 (#28358)

2025-11-13 10:16:55 -08:00

test_config.py

…

test_embedded_commit.py

…

test_envs.py

[Misc] fix comment in test_envs (#28529)

2025-11-14 09:32:46 +00:00

test_inputs.py

…

test_logger.py

[torch.compile] Enable attention and allreduce fusion without custom ops enabled (#24604)

2025-10-17 08:10:23 -06:00

test_logprobs.py

[Misc] FlattenLogprobs -> FlatLogprobs (#28335)

2025-11-11 03:41:23 +00:00

test_outputs.py

…

test_pooling_params.py

[Frontend][Doc][5/N] Improve all pooling task | Polish encode (pooling) api & Document. (#25524)

2025-10-30 12:13:05 +00:00

test_regression.py

…

test_routing_simulator.py

…

test_scalartype.py

…

test_seed_behavior.py

…

test_sequence.py

…

test_triton_utils.py

…

test_version.py

…

test_vllm_port.py

…

utils.py

Adds anthropic /v1/messages endpoint to openai api_server (#27882)

2025-11-01 12:45:42 -07:00