Chen Bruce 7ea5c73ad7

[Feat][EPLB] A novel static EPLB placement strategy for MoE models. (#23745) ...

Signed-off-by: bruceszchen <bruceszchen@tencent.com>
Signed-off-by: Chen Bruce <bruceszchen@tencent.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Chen Bruce <cszwwdz@vip.qq.com>
Co-authored-by: lemon412 <lemon412@foxmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

2025-09-16 10:55:16 +00:00

..

async_engine

[CI] Fail subprocess tests with root-cause error (#23795)

2025-09-10 13:53:21 -07:00

basic_correctness

[Core] Support async scheduling with uniproc executor (#24219)

2025-09-12 16:34:28 -07:00

benchmarks

[Misc] Support bench serve long context (#24373)

2025-09-08 22:53:10 -07:00

compile

[Compile] Fix noop_elimination pass and add tests for noop_elimination (#24880)

2025-09-15 23:33:18 +00:00

config

[V0 Deprecation] Remove multi-step scheduling (#22138)

2025-08-12 20:18:39 -07:00

core

Remove V0 Encoder-Decoder Support (#24907)

2025-09-15 21:17:14 -07:00

cuda

[Bugfix][Ray] Set the cuda context eagerly in the ray worker (#19583)

2025-06-19 22:01:16 -07:00

detokenizer

[Bugfix] Handle the edge case in detokenizer where processed tokens contain both stop str and eos token (#23938)

2025-09-09 07:30:24 -07:00

distributed

[Feat][EPLB] A novel static EPLB placement strategy for MoE models. (#23745)

2025-09-16 10:55:16 +00:00

engine

[Frontend] Skip stop in reasoning content (#14550)

2025-09-15 06:04:55 +00:00

entrypoints

Remove V0 Encoder-Decoder Support (#24907)

2025-09-15 21:17:14 -07:00

evals/gsm8k

[CI] Small Accuracy Eval Test for Deepseek Model (#24259)

2025-09-15 20:14:50 -06:00

fastsafetensors_loader

[Core] Support model loader plugins (#21067)

2025-07-24 01:49:44 -07:00

kernels

Remove V0 Encoder-Decoder Support (#24907)

2025-09-15 21:17:14 -07:00

kv_transfer

Remove deprecated PyNcclConnector (#24151)

2025-09-03 22:49:16 +00:00

lora

Move LoRAConfig from config/__init__.py to config/lora.py (#24644)

2025-09-11 11:01:38 +00:00

metrics

[V0 Deprecation] Remove multi-step scheduling (#22138)

2025-08-12 20:18:39 -07:00

mistral_tool_use

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

model_executor

Move LoadConfig from config/__init__.py to config/load.py (#24566)

2025-09-10 06:14:18 -07:00

models

Remove V0 Encoder-Decoder Support (#24907)

2025-09-15 21:17:14 -07:00

mq_llm_engine

[Flaky CI] Increase timeout tolerance for test_mp_crash_detection+test_default_mm_lora_chat_completions (#23028)

2025-08-16 18:33:08 +00:00

multimodal

Move MultiModalConfig from config/__init__.py to config/multimodal.py (#24659)

2025-09-15 17:43:16 +00:00

plugins

[Misc] Terratorch related fixes (#24337)

2025-09-08 06:40:26 -07:00

plugins_tests

[Misc] Terratorch related fixes (#24337)

2025-09-08 06:40:26 -07:00

prompts

[BugFix] Fix input positions for long context with sliding window (#2088)

2023-12-13 12:28:13 -08:00

quantization

[torchao] Support quantization configs using module swap (#21982)

2025-09-10 23:53:24 -07:00

reasoning

Add think chunk (#21333)

2025-07-23 21:51:32 -07:00

runai_model_streamer_test

Move LoadConfig from config/__init__.py to config/load.py (#24566)

2025-09-10 06:14:18 -07:00

samplers

fix some typos (#24071)

2025-09-02 20:44:50 -07:00

speculative_decoding/speculators

Add: SupportsEagle3 interface for explicit EAGLE3 support (#22642)

2025-08-12 09:24:52 -07:00

standalone_tests

[CI] Remove duplicated docs build from buildkite (#22924)

2025-08-15 05:58:06 -07:00

system_messages

[V1] Implement Cascade Attention (#11635)

2025-01-01 21:56:46 +09:00

tensorizer_loader

[Core] Shared memory based object store for Multimodal data caching and IPC (#20452)

2025-09-12 07:54:17 -07:00

tokenization

[Multimodal] Consolidate mm inputs into MultiModalFeatureSpec (#23779)

2025-08-29 18:36:57 +08:00

tool_use

[gpt-oss] tool parser supports for /chat/completions [1/n] (#22386)

2025-09-04 20:39:12 -07:00

tools

[Perf] Validate @config in pre-commit instead of dynamically (#20200)

2025-07-01 05:10:28 -04:00

tpu

[Doc]: fixing typos to improve docs (#24480)

2025-09-08 23:06:04 -07:00

tracing

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

transformers_utils

[Core] Support configuration parsing plugin (#24277)

2025-09-10 11:32:43 -07:00

utils_

Remove V0 Encoder-Decoder Support (#24907)

2025-09-15 21:17:14 -07:00

v1

Remove V0 Encoder-Decoder Support (#24907)

2025-09-15 21:17:14 -07:00

vllm_test_utils

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

weight_loading

[Kernel/Quant] Remove the original marlin format and qqq (#23204)

2025-08-20 15:13:36 -04:00

worker

Remove V0 Encoder-Decoder Support (#24907)

2025-09-15 21:17:14 -07:00

__init__.py

[Small] Formatter only checks lints in changed files (#1528)

2023-10-31 15:39:38 -07:00

build_cython.py

[Refactor] Refactor import utils (#20269)

2025-07-01 18:05:42 -07:00

ci_envs.py

[CI] Add ci_envs for convenient local testing (#24630)

2025-09-12 08:52:25 +00:00

conftest.py

[CI] Fail subprocess tests with root-cause error (#23795)

2025-09-10 13:53:21 -07:00

test_cache_block_hashing.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_config.py

Remove V0 Encoder-Decoder Support (#24907)

2025-09-15 21:17:14 -07:00

test_embedded_commit.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_inputs.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_logger.py

feat: Add --enable-log-outputs flag for logging model generations (#20707)

2025-08-06 23:10:13 -07:00

test_outputs.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_pooling_params.py

[Model] Pooling model activation supports per request control by PoolingParams (#20538)

2025-08-05 00:37:00 -07:00

test_regression.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_routing_simulator.py

[Misc] Support routing logic simulation (#21990)

2025-08-06 23:06:20 -07:00

test_sampling_params.py

[V0 deprecation] Guided decoding (#21347)

2025-07-29 03:15:30 -07:00

test_scalartype.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_seed_behavior.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_sequence.py

[Bugfix] fix IntermediateTensors equal method (#23027)

2025-08-18 02:58:11 -07:00

test_sharded_state_loader.py

[Misc] normalize multiprocessing Queue usage (#22371)

2025-08-08 01:57:27 +00:00

test_test.py

[Model] Gemma3n MM (#20495)

2025-08-09 09:56:25 -07:00

test_triton_utils.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_version.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_vllm_port.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

utils.py

[CI] Fail subprocess tests with root-cause error (#23795)

2025-09-10 13:53:21 -07:00