Yifan Qiao 48ddb02b79

[Hybrid Allocator] Support KV cache groups with different block_size (#29143) ...

Signed-off-by: Yifan Qiao <yifanqiao@berkeley.edu>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>

2025-11-25 10:30:57 -05:00

..

__init__.py

…

test_async_scheduler.py

Revert "[Redo] #26368 (#28771)" (#29121)

2025-11-20 21:27:45 -08:00

test_encoder_cache_manager.py

…

test_kv_cache_utils.py

[Hybrid Allocator] Support KV cache groups with different block_size (#29143)

2025-11-25 10:30:57 -05:00

test_kv_sharing.py

…

test_prefix_caching.py

[Hybrid Allocator] Support KV cache groups with different block_size (#29143)

2025-11-25 10:30:57 -05:00

test_priority_scheduler_random.py

Revert "[Redo] #26368 (#28771)" (#29121)

2025-11-20 21:27:45 -08:00

test_scheduler_e2e.py

…

test_scheduler.py

[Bugfix] If chunked_prefill is disabled, end the scheduling early. (#28911)

2025-11-25 16:06:09 +08:00

test_single_type_kv_cache_manager.py

[Hybrid Allocator] Support KV cache groups with different block_size (#29143)

2025-11-25 10:30:57 -05:00

utils.py

[Bugfix] If chunked_prefill is disabled, end the scheduling early. (#28911)

2025-11-25 16:06:09 +08:00