Jialin Ouyang 4228be7959

[Perf] Use np.ndarray instead of list[list[int]] to reduce GC overhead (#28245) ...

Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>

2025-11-11 10:28:47 -08:00

..

attention

[Attention] Refactor CUDA attention backend selection logic (#24794)

2025-11-11 07:40:44 -05:00

core

[Hybrid allocator + kv connector] revert connector test changes related to hybrid allocator (#28011)

2025-11-05 10:36:31 +00:00

cudagraph

…

distributed

[Test] Add non-MoE DP test coverage (#28235)

2025-11-06 20:59:57 +00:00

e2e

[CI] Fix flaky test_eagle_correctness test (#28364)

2025-11-09 16:04:59 +00:00

engine

[Perf] Use np.ndarray instead of list[list[int]] to reduce GC overhead (#28245)

2025-11-11 10:28:47 -08:00

entrypoints

reasoning_content -> reasoning (#27752)

2025-11-08 12:15:08 +00:00

executor

[Core] Simplify async KV output aggregation (#28327)

2025-11-09 09:44:13 -08:00

generation

[Feature] Extend batch invariant torch.compile to B200 (#27856)

2025-11-05 10:04:49 -08:00

kv_connector

[NIXL] Generalize block-first backend layouts (FlashInfer-like) (#28282)

2025-11-11 16:57:43 +00:00

kv_offload

[KV offload] Enable CPU KV offload on CUDA alike Platforms (#27770)

2025-10-30 22:10:29 +08:00

logits_processors

[Bugfix] Validate custom logits processor xargs for online serving (#27560)

2025-11-05 16:53:33 +00:00

metrics

[Metrics] Refactor LoRA state tracking (#26801)

2025-11-10 16:34:36 +08:00

sample

[V0 deprecation] Remove VLLM_USE_V1 usage in most modules (#27955)

2025-11-04 20:51:16 -08:00

shutdown

…

spec_decode

[Attention] Refactor CUDA attention backend selection logic (#24794)

2025-11-11 07:40:44 -05:00

structured_output

[Bugfix] Fix llguidance backend, rollback when EOS was encountered (#25905)

2025-11-10 14:53:32 -05:00

tpu

[Core] Async scheduling + structured outputs compatibility (#26866)

2025-11-01 00:35:04 +00:00

tracing

…

worker

[Attention] Refactor CUDA attention backend selection logic (#24794)

2025-11-11 07:40:44 -05:00

__init__.py

…

test_oracle.py

[V0 deprecation]clean up is_v1_supported_oracle (#28116)

2025-11-06 16:05:32 +08:00

test_outputs.py

Fix cu_num_generated_tokens slicing logic in LogprobsLists.slice() method (#28214)

2025-11-09 19:11:46 +00:00

test_request.py

…

test_serial_utils.py

…

utils.py

…