xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-14 20:35:40 +08:00
Code Issues Packages Projects Releases Wiki Activity

[Misc] rename interval to max_recent_requests (#24229)

Browse Source 
Signed-off-by: Andy Xie <andy.xning@gmail.com>
This commit is contained in:
Ning Xie 2025-09-15 17:18:42 +08:00 committed by GitHub
parent 4979eb79da
commit 59e17dd4a0
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
vllm/v1/core/kv_cache_utils.py
View File

@ -116,8 +116,8 @@ class PrefixCachingMetrics:
This function is called with information gathered when new requests This function is called with information gathered when new requests
are being scheduled and are looking for computed blocks. are being scheduled and are looking for computed blocks.
When there are more than `interval` requests, the oldest set of When there are more than `max_recent_requests` requests, the oldest set
requests are removed from the metrics. of requests are removed from the metrics.
Args: Args:
stats: The prefix cache stats. stats: The prefix cache stats.