Ning Xie d310e6de98

[BUGFIX]: return fast when request requires prompt logprobs (#17251)

2025-05-08 21:25:41 -07:00

..

test_kv_cache_utils.py

[v1] Introduce KVCacheBlocks as interface between Scheduler and KVCacheManager (#17479)

2025-05-06 08:50:34 -07:00

test_prefix_caching.py

[BUGFIX]: return fast when request requires prompt logprobs (#17251)

2025-05-08 21:25:41 -07:00

test_scheduler_e2e.py

[V1] Support long_prefill_token_threshold in v1 scheduler (#15419)

2025-03-25 14:22:26 -07:00

test_scheduler.py

Add full API docs and improve the UX of navigating them (#17485)

2025-05-03 19:42:43 -07:00

test_specialized_manager.py

[v1][Spec Decode] Make sliding window compatible with eagle prefix caching (#17398)

2025-04-30 18:25:53 +00:00