Zhewen Li 0fe0140408

[KV offload] Enable CPU KV offload on CUDA alike Platforms (#27770) ...

Signed-off-by: zhewenli <zhewenli@meta.com>

2025-10-30 22:10:29 +08:00

..

attention

[BugFix] Reordering extend logic fix (#27739)

2025-10-29 21:39:34 -07:00

core

[Core][Hybrid allocator + kv connector 1/n] Enable hybrid allocator + KV cache connector (#25712)

2025-10-24 23:34:18 -07:00

cudagraph

[CI] Add tests for cudagraph (#27391)

2025-10-25 02:37:33 +00:00

distributed

[Bugfix][CI] Fix Distributed Tests (4 GPUs) async_sched+ray test (#27195)

2025-10-20 16:34:54 +00:00

e2e

[Speculators] Move tests + fix integration (#27308)

2025-10-29 00:54:21 -07:00

engine

[Chore]:Extract math and argparse utilities to separate modules (#27188)

2025-10-26 04:03:32 -07:00

entrypoints

[CI] Fix flaky test_two_responses_with_same_prev_id test (#27745)

2025-10-29 15:10:35 +00:00

executor

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

generation

[Test] Batch Invariant: Unit test using parameterized backend (#27478)

2025-10-28 13:51:35 -07:00

kv_connector

[Core][Hybrid allocator + kv connector 1/n] Enable hybrid allocator + KV cache connector (#25712)

2025-10-24 23:34:18 -07:00

kv_offload

[KV offload] Enable CPU KV offload on CUDA alike Platforms (#27770)

2025-10-30 22:10:29 +08:00

logits_processors

[Chore] Separate out vllm.utils.platform_utils.py (#27374)

2025-10-23 19:08:06 +00:00

metrics

[V1][Metrics][Plugin] Add plugin support for custom StatLoggerBase implementations (#22456)

2025-10-18 15:12:46 -07:00

sample

[Chore] Separate out vllm.utils.platform_utils.py (#27374)

2025-10-23 19:08:06 +00:00

shutdown

[Chore] Clean up pytorch helper functions in vllm.utils (#26908)

2025-10-18 09:48:22 -07:00

spec_decode

[Speculators] Move tests + fix integration (#27308)

2025-10-29 00:54:21 -07:00

structured_output

Updated xgrammar backend to not deny supported string formats (#27253)

2025-10-21 22:25:23 +00:00

tpu

[BugFix] Handle unscheduled requests properly when async scheduling (#27756)

2025-10-29 21:04:25 -07:00

tracing

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

worker

[BugFix] Handle unscheduled requests properly when async scheduling (#27756)

2025-10-29 21:04:25 -07:00

__init__.py

…

test_oracle.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_request.py

…

test_serial_utils.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

utils.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00