xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-10 08:04:58 +08:00
Code Issues Packages Projects Releases Wiki Activity

prefix_caching.md: Fixed typo (#14293)

Browse Source 
Signed-off-by: Daivid Savernin-Frenk <daivid.frank@TurboNext.ai>
This commit is contained in:
DaividFrank 2025-03-05 16:43:13 +01:00 committed by GitHub
parent 7bab4bb048
commit 8f808cf86e
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
docs/source/design/v1/prefix_caching.md
View File

@ -183,7 +183,7 @@ When a request is finished, we free all its blocks if no other requests are usin
When the head block (least recently used block) of the free queue is cached, we have to evict the block to prevent it from being used by other requests. Specifically, eviction involves the following steps:
1. Pop the block from the head of the free queue. This is the LRU black to be evicted.
1. Pop the block from the head of the free queue. This is the LRU block to be evicted.
2. Remove the block ID from the Cache Block.
3. Remove the block hash.