iAmir97 7655dc3e45

[Bugfix] Add reset prefix cache for online serving (#22726) ...

Signed-off-by: iAmir97 <Amir.balwel@embeddedllm.com>
Signed-off-by: iAmir97 <71513472+iAmir97@users.noreply.github.com>
Co-authored-by: iAmir97 <Amir.balwel@embeddedllm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

2025-08-14 04:04:18 -07:00

..

__init__.py

[Core] Use individual MM items in P0/P1 cache and model runner (#22570)

2025-08-13 07:18:07 -07:00

async_llm.py

[Bugfix] Add reset prefix cache for online serving (#22726)

2025-08-14 04:04:18 -07:00

coordinator.py

[BugFix] Improve internal DP load balancing (#21617)

2025-08-01 19:45:27 -07:00

core_client.py

[BugFix] Threadsafe close async zmq sockets (#22877)

2025-08-14 03:44:29 -07:00

core.py

[Core] Use individual MM items in P0/P1 cache and model runner (#22570)

2025-08-13 07:18:07 -07:00

detokenizer.py

Support embedding models in V1 (#16188)

2025-06-18 21:36:33 -07:00

exceptions.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

llm_engine.py

[CI/Build] Fix multimodal tests (#22491)

2025-08-08 00:31:19 -07:00

logprobs.py

[Sampler] Support returning all logprobs or logits (#21792)

2025-08-04 03:04:12 -07:00

mm_input_cache.py

[Core] Use individual MM items in P0/P1 cache and model runner (#22570)

2025-08-13 07:18:07 -07:00

output_processor.py

[Core][Model] PrithviMAE Enablement on vLLM v1 engine (#20577)

2025-07-23 11:00:23 -07:00

parallel_sampling.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

processor.py

[Core] Use individual MM items in P0/P1 cache and model runner (#22570)

2025-08-13 07:18:07 -07:00

utils.py

[Bugfix] Skip dead and non-GPU nodes for Ray DP engine allocation (#22275)

2025-08-05 20:35:32 -07:00