Jialin Ouyang 186352b270

[Core] Performance: Use list[np.ndarray] instead of list[list[int]] for output tokens for GC optimization (#26368) ...

Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>

2025-11-14 16:04:04 -08:00

..

__init__.py

[P/D] NIXL Integration (#17751)

2025-05-12 09:46:16 -07:00

test_backwards_compatibility.py

[KV Connector] Make KVCacheConfig an explicit constructor argument (#27887)

2025-11-03 23:00:49 -08:00

test_config.py

[Add] cmdline argument parsing for KV cache offloading modules (#27621)

2025-11-01 07:17:07 +00:00

test_decode_bench_connector.py

[P/D] KVConnector for decode benchmarking (#25986)

2025-10-21 16:30:47 -07:00

test_kv_connector_lifecyle.py

[Core] Async scheduling + structured outputs compatibility (#26866)

2025-11-01 00:35:04 +00:00

test_kv_load_failure_recovery.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

test_lmcache_integration.py

[CI]: Add LMCacheConnector Unit Tests (#27852)

2025-11-05 09:45:57 -08:00

test_multi_connector.py

[Hybrid allocator + kv connector] revert connector test changes related to hybrid allocator (#28011)

2025-11-05 10:36:31 +00:00

test_nixl_connector.py

[NIXL] Generalize block-first backend layouts (FlashInfer-like) (#28282)

2025-11-11 16:57:43 +00:00

test_offloading_connector.py

[Chore] Separate out hashing utilities from vllm.utils (#27151)

2025-10-19 11:09:38 +08:00

test_output_aggregator.py

[Core] Simplify async KV output aggregation (#28327)

2025-11-09 09:44:13 -08:00

test_remote_decode_lifecycle.py

[NIXL] Ignore abort on already-finished request (#25067)

2025-10-10 12:21:56 +02:00

test_remote_prefill_lifecycle.py

…

test_shared_storage_connector.py

[Hybrid allocator + kv connector] revert connector test changes related to hybrid allocator (#28011)

2025-11-05 10:36:31 +00:00

utils.py

[Core] Performance: Use list[np.ndarray] instead of list[list[int]] for output tokens for GC optimization (#26368)

2025-11-14 16:04:04 -08:00