Nick Hill b9dc9d2607

[BugFix] Handle case where async utility call is cancelled (#22996) ...

Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Yinghai Lu <yinghai@thinkingmachines.ai>

2025-08-15 17:38:42 -06:00

..

async_engine

[V0 Deprecation] Remove multi-step scheduling (#22138)

2025-08-12 20:18:39 -07:00

basic_correctness

[Misc] unify variable for LLM instance (#20996)

2025-07-21 12:18:33 +01:00

benchmarks

[Spec Decode][Benchmark] Generalize spec decode offline benchmark to more methods and datasets (#18847)

2025-06-12 10:30:56 -07:00

compile

[Core] Allow full cudagraph with separate attention routines and orthogonal to compilation, add support for FA2 and FlashInfer (#20059)

2025-08-15 10:01:39 -04:00

config

[V0 Deprecation] Remove multi-step scheduling (#22138)

2025-08-12 20:18:39 -07:00

core

[V0 Deprecation] Remove multi-step scheduling (#22138)

2025-08-12 20:18:39 -07:00

cuda

[Bugfix][Ray] Set the cuda context eagerly in the ray worker (#19583)

2025-06-19 22:01:16 -07:00

detokenizer

[Misc] unify variable for LLM instance (#20996)

2025-07-21 12:18:33 +01:00

distributed

[Misc] Begin deprecation of get_tensor_model_*_group (#22494)

2025-08-08 01:11:54 -07:00

encoder_decoder

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

engine

[V0 Deprecation] Remove multi-step scheduling (#22138)

2025-08-12 20:18:39 -07:00

entrypoints

[CI] Speed up Whisper tests by reusing server (#22859)

2025-08-15 16:56:31 -04:00

fastsafetensors_loader

[Core] Support model loader plugins (#21067)

2025-07-24 01:49:44 -07:00

kernels

minor: zero workspace buffer init for flashinfer trtllm-gen attn (#22603)

2025-08-15 21:38:10 +00:00

kv_transfer

[V0 deprecation][P/D] Deprecate v0 KVConnectorBase code (1/2) (#21785)

2025-08-04 19:11:33 -07:00

lora

[Misc] Modify the organization of GLM series (#22171)

2025-08-03 23:51:20 -07:00

metrics

[V0 Deprecation] Remove multi-step scheduling (#22138)

2025-08-12 20:18:39 -07:00

mistral_tool_use

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

model_executor

[V0 deprecation] Guided decoding (#21347)

2025-07-29 03:15:30 -07:00

models

[V1] [Hybrid] Support using float32 for state in Hybrid Models (Mamba2, Mamba1, Minimax) (#22928)

2025-08-15 12:57:06 +00:00

mq_llm_engine

Deprecate --disable-log-requests and replace with --enable-log-requests (#21739)

2025-08-01 17:16:37 +01:00

multimodal

Improve multimodal hasher performance for re-used Image prompts (#22825)

2025-08-15 12:32:56 +00:00

neuron

[Misc] Remove deprecated args in v0.10 (#21349)

2025-07-22 05:26:39 -07:00

plugins

[gpt-oss] Enable gpt-oss on ampere (#22714)

2025-08-12 03:21:44 -07:00

plugins_tests

[Bugfix] Remove faulty test for oot attention backend (#22286)

2025-08-06 00:05:40 +00:00

prefix_caching

[Misc] unify variable for LLM instance (#20996)

2025-07-21 12:18:33 +01:00

prompts

[BugFix] Fix input positions for long context with sliding window (#2088)

2023-12-13 12:28:13 -08:00

quantization

Update transformers to v4.55 (#21931)

2025-08-05 22:56:14 -07:00

reasoning

Add think chunk (#21333)

2025-07-23 21:51:32 -07:00

runai_model_streamer_test

[Core] Support model loader plugins (#21067)

2025-07-24 01:49:44 -07:00

samplers

[V0 Deprecation] Remove multi-step scheduling (#22138)

2025-08-12 20:18:39 -07:00

speculative_decoding/speculators

Add: SupportsEagle3 interface for explicit EAGLE3 support (#22642)

2025-08-12 09:24:52 -07:00

standalone_tests

[CI] Remove duplicated docs build from buildkite (#22924)

2025-08-15 05:58:06 -07:00

system_messages

[V1] Implement Cascade Attention (#11635)

2025-01-01 21:56:46 +09:00

tensorizer_loader

[CI/Build] Fix tensorizer test for load_format change (#22583)

2025-08-10 19:30:00 -07:00

tokenization

[Misc] Modify the organization of GLM series (#22171)

2025-08-03 23:51:20 -07:00

tool_use

[Bugfix]: Fix the streaming output for function calls in the minimax (#22015)

2025-08-06 20:30:27 -07:00

tools

[Perf] Validate @config in pre-commit instead of dynamically (#20200)

2025-07-01 05:10:28 -04:00

tpu

[V0 Deprecation] Remove multi-step scheduling (#22138)

2025-08-12 20:18:39 -07:00

tracing

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

utils_

[V0 Deprecation] Remove args for multi-step scheduling (#22779)

2025-08-12 20:38:18 -07:00

v1

[BugFix] Handle case where async utility call is cancelled (#22996)

2025-08-15 17:38:42 -06:00

vllm_test_utils

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

weight_loading

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

worker

[V0 Deprecation] Remove multi-step scheduling (#22138)

2025-08-12 20:18:39 -07:00

__init__.py

[Small] Formatter only checks lints in changed files (#1528)

2023-10-31 15:39:38 -07:00

build_cython.py

[Refactor] Refactor import utils (#20269)

2025-07-01 18:05:42 -07:00

conftest.py

[Misc] Add tensor schema test coverage for multimodal models (#21754)

2025-08-03 00:52:14 -07:00

test_cache_block_hashing.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_config.py

[Model] Pooling models default to using chunked prefill & prefix caching if supported. (#20930)

2025-08-11 09:41:37 -07:00

test_embedded_commit.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_inputs.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_logger.py

feat: Add --enable-log-outputs flag for logging model generations (#20707)

2025-08-06 23:10:13 -07:00

test_outputs.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_pooling_params.py

[Model] Pooling model activation supports per request control by PoolingParams (#20538)

2025-08-05 00:37:00 -07:00

test_regression.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_routing_simulator.py

[Misc] Support routing logic simulation (#21990)

2025-08-06 23:06:20 -07:00

test_sampling_params.py

[V0 deprecation] Guided decoding (#21347)

2025-07-29 03:15:30 -07:00

test_scalartype.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_seed_behavior.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_sequence.py

[V0 Deprecation] Remove V0 Spec Decode workers (#21152)

2025-07-18 21:47:50 -07:00

test_sharded_state_loader.py

[Misc] normalize multiprocessing Queue usage (#22371)

2025-08-08 01:57:27 +00:00

test_test.py

[Model] Gemma3n MM (#20495)

2025-08-09 09:56:25 -07:00

test_triton_utils.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_version.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_vllm_port.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

utils.py

[Frontend] Add unix domain socket support (#18097)

2025-08-08 16:23:44 -07:00