Tova Movshovitz 88afa11010

[Metrics] [KVConnector] Add connector prefix cache hit rate stats (#26245) ...

Signed-off-by: tovam <tovam@pliops.com>

2025-10-23 12:21:08 +02:00

..

attention

[BugFix] bugfix for Flash Attention MLA with full cuda graph IMA following pr-25490 (#27128)

2025-10-22 19:36:39 +00:00

core

[Metrics] [KVConnector] Add connector prefix cache hit rate stats (#26245)

2025-10-23 12:21:08 +02:00

engine

[Model] Add num_cached_tokens for PoolingRequestOutput (#27378)

2025-10-23 14:03:42 +08:00

executor

[Chore] Separate out system utilities from vllm.utils (#27201)

2025-10-22 20:25:25 +00:00

kv_offload

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

metrics

[Metrics] [KVConnector] Add connector prefix cache hit rate stats (#26245)

2025-10-23 12:21:08 +02:00

pool

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

sample

[V1][spec decode] return logprobs for spec decoding (#26060)

2025-10-22 22:59:59 -07:00

spec_decode

[V1][spec decode] return logprobs for spec decoding (#26060)

2025-10-22 22:59:59 -07:00

structured_output

Updated xgrammar backend to not deny supported string formats (#27253)

2025-10-21 22:25:23 +00:00

worker

[V1][spec decode] return logprobs for spec decoding (#26060)

2025-10-22 22:59:59 -07:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

cudagraph_dispatcher.py

[LoRA] LoRA cuda graph specialization (#25914)

2025-10-20 04:21:09 +00:00

kv_cache_interface.py

[Chore] Clean up pytorch helper functions in vllm.utils (#26908)

2025-10-18 09:48:22 -07:00

outputs.py

[V1][spec decode] return logprobs for spec decoding (#26060)

2025-10-22 22:59:59 -07:00

request.py

[Core] Streamline some structured output related code (#26737)

2025-10-14 23:27:44 +00:00

serial_utils.py

[CORE] Support Prefix Caching with Prompt Embeds (#27219)

2025-10-22 22:18:07 -07:00

utils.py

[CORE] Support Prefix Caching with Prompt Embeds (#27219)

2025-10-22 22:18:07 -07:00