Or Ozeri 8db2939289

[KV offload][5/N] Add CPUOffloadingSpec (#24251) ...

Signed-off-by: Or Ozeri <oro@il.ibm.com>

2025-09-22 12:30:36 -07:00

..

basic_correctness

[V0 Deprecation] Remove LLMEngine (#25033)

2025-09-20 17:56:30 -07:00

benchmarks

[Misc] Clean up flags in vllm bench serve (#25138)

2025-09-18 12:43:33 +00:00

compile

[torch.compile] Cleanup compilation tests and custom passes, add debug utils, fix DCE bug (#23091), fix test (#24376), and prep for custom op matching (#24604) (#24542)

2025-09-22 12:30:05 -07:00

config

[V0 Deprecation] Remove multi-step scheduling (#22138)

2025-08-12 20:18:39 -07:00

cuda

[Bugfix][Ray] Set the cuda context eagerly in the ray worker (#19583)

2025-06-19 22:01:16 -07:00

detokenizer

[V0 Deprecation] Remove async_output_proc, preemption mode, delay factor (#25334)

2025-09-21 08:52:32 -07:00

distributed

[DP] support torchrun external launcher with Data Parallelism (#24899)

2025-09-22 12:06:05 -07:00

engine

[V0 Deprecation] Remove V0 Engine tests (#25114)

2025-09-17 19:38:09 -07:00

entrypoints

[Bugfix] Fix hermes tool parser handling of non-string argument types (#22002)

2025-09-22 11:35:39 +08:00

evals

[Docs] GSM8K Accuracy Evaluation doc update (#25360)

2025-09-22 02:49:13 +00:00

fastsafetensors_loader

[Core] Support model loader plugins (#21067)

2025-07-24 01:49:44 -07:00

kernels

[V0 Deprecation] Remove MultiModalPlaceholderMap (#25366)

2025-09-22 08:49:19 +00:00

kv_transfer

Remove deprecated PyNcclConnector (#24151)

2025-09-03 22:49:16 +00:00

lora

[Chore] Remove unused sampler in models (#25324)

2025-09-20 19:53:20 -07:00

mistral_tool_use

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

model_executor

[V0 Deprecation] Remove misc V0 tests (#25118)

2025-09-17 19:41:55 -07:00

models

[V0 Deprecation] Remove V0-only methods in multi-modal registry (#25362)

2025-09-22 13:58:26 +08:00

multimodal

Multimodal - audio tests (#25285)

2025-09-22 07:07:11 +08:00

plugins

[V0 Deprecation] Remove V0 sampling metadata (#25345)

2025-09-21 10:37:11 -07:00

plugins_tests

[V0 Deprecation] Remove LLMEngine (#25033)

2025-09-20 17:56:30 -07:00

prompts

[BugFix] Fix input positions for long context with sliding window (#2088)

2023-12-13 12:28:13 -08:00

quantization

[CI] Skip tests failing on main (#25326)

2025-09-20 19:57:46 -07:00

reasoning

Add think chunk (#21333)

2025-07-23 21:51:32 -07:00

runai_model_streamer_test

Move LoadConfig from config/__init__.py to config/load.py (#24566)

2025-09-10 06:14:18 -07:00

samplers

[V0 Deprecation] Remove LLMEngine (#25033)

2025-09-20 17:56:30 -07:00

speculative_decoding/speculators

feat: Enable engine-level arguments with speculators models (#25250)

2025-09-21 11:04:45 -06:00

standalone_tests

[CI] Remove duplicated docs build from buildkite (#22924)

2025-08-15 05:58:06 -07:00

system_messages

[V1] Implement Cascade Attention (#11635)

2025-01-01 21:56:46 +09:00

tensorizer_loader

[Core] Shared memory based object store for Multimodal data caching and IPC (#20452)

2025-09-12 07:54:17 -07:00

tokenization

[V0 Deprecation] Remove V0 Sequence class & Sampler (#25332)

2025-09-21 08:52:15 -07:00

tool_use

[V0 Deprecation] Remove V0 Sequence class & Sampler (#25332)

2025-09-21 08:52:15 -07:00

tools

[Perf] Validate @config in pre-commit instead of dynamically (#20200)

2025-07-01 05:10:28 -04:00

tpu

[TPU] Deprecate xm.mark_step in favor of `torch_xla.sync (#25254)

2025-09-22 10:12:57 +00:00

transformers_utils

[Core] Support configuration parsing plugin (#24277)

2025-09-10 11:32:43 -07:00

utils_

Remove V0 Encoder-Decoder Support (#24907)

2025-09-15 21:17:14 -07:00

v1

[KV offload][5/N] Add CPUOffloadingSpec (#24251)

2025-09-22 12:30:36 -07:00

vllm_test_utils

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

weight_loading

[Kernel/Quant] Remove the original marlin format and qqq (#23204)

2025-08-20 15:13:36 -04:00

__init__.py

[Small] Formatter only checks lints in changed files (#1528)

2023-10-31 15:39:38 -07:00

ci_envs.py

[CI] Add ci_envs for convenient local testing (#24630)

2025-09-12 08:52:25 +00:00

conftest.py

[V0 Deprecation] Remove V0 Sequence class & Sampler (#25332)

2025-09-21 08:52:15 -07:00

test_config.py

Move PoolerConfig from config/__init__.py to config/pooler.py (#25181)

2025-09-19 11:02:55 +00:00

test_embedded_commit.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_inputs.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_logger.py

feat: Add --enable-log-outputs flag for logging model generations (#20707)

2025-08-06 23:10:13 -07:00

test_outputs.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_pooling_params.py

[Model] Pooling model activation supports per request control by PoolingParams (#20538)

2025-08-05 00:37:00 -07:00

test_regression.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_routing_simulator.py

[Misc] Support routing logic simulation (#21990)

2025-08-06 23:06:20 -07:00

test_scalartype.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_seed_behavior.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_sequence.py

[V0 Deprecation] Remove V0 tests in test_sequence.py (#25088)

2025-09-17 11:08:45 -07:00

test_sharded_state_loader.py

[Core] Enable sharded state loader for V1 engine and enhance test coverage (#25308)

2025-09-20 21:15:22 +08:00

test_test.py

[Model] Gemma3n MM (#20495)

2025-08-09 09:56:25 -07:00

test_triton_utils.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_version.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_vllm_port.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

utils.py

[CI] Revert back prepare_prompts and check_answers (#25087)

2025-09-17 11:03:16 -07:00