Chen Zhang 994fc655b7

[V1][Prefix Cache] Move the logic of num_computed_tokens into KVCacheManager (#12003)

2025-01-15 07:55:30 +00:00

..

test_kv_cache_utils.py

[V1] Extend beyond image modality and support mixed-modality inference with Llava-OneVision (#11685)

2025-01-06 19:58:16 +00:00

test_prefix_caching.py

[V1][Prefix Cache] Move the logic of num_computed_tokens into KVCacheManager (#12003)

2025-01-15 07:55:30 +00:00