ElizaWszola 9474e89ba4

[PREFIX CACHING FOLLOW UP] A bunch of fixes to block allocator performance when automatic prefix caching is disabled (#3357) ...

Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>

2024-03-20 00:11:11 -07:00

..

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

block_manager.py

[PREFIX CACHING FOLLOW UP] A bunch of fixes to block allocator performance when automatic prefix caching is disabled (#3357)

2024-03-20 00:11:11 -07:00

evictor.py

[PREFIX CACHING FOLLOW UP] A bunch of fixes to block allocator performance when automatic prefix caching is disabled (#3357)

2024-03-20 00:11:11 -07:00

policy.py

Add metrics to RequestOutput (#2876)

2024-02-20 21:55:57 -08:00

scheduler.py

Fixes the misuse/mixuse of time.time()/time.monotonic() (#3220)

2024-03-15 18:25:43 +00:00