Lumis Chen 9bcf92295a

[Core] Add xxHash as a high-performance hash option for accelerating prefix caching (#29163) ...

Signed-off-by: LuminolT <lumischen01@gmail.com>
Signed-off-by: Lumis Chen <lumischen01@gmail.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>

2025-12-03 16:06:57 +00:00

..

sched

Add logging for cudagraph related info (#29825)

2025-12-03 01:01:48 -08:00

__init__.py

…

block_pool.py

[Core][Observability] Add KV cache residency metrics (#27793)

2025-12-01 18:27:53 +00:00

encoder_cache_manager.py

…

kv_cache_coordinator.py

[Core][Observability] Add KV cache residency metrics (#27793)

2025-12-01 18:27:53 +00:00

kv_cache_manager.py

[Doc] Add allocate_slots parameter docs (#29777)

2025-12-02 23:23:09 +00:00

kv_cache_metrics.py

[Core][Observability] Add KV cache residency metrics (#27793)

2025-12-01 18:27:53 +00:00

kv_cache_utils.py

[Core] Add xxHash as a high-performance hash option for accelerating prefix caching (#29163)

2025-12-03 16:06:57 +00:00

single_type_kv_cache_manager.py

[Hybrid Allocator] Support KV cache groups with different block_size (#29143)

2025-11-25 10:30:57 -05:00