youkaichao ba81163997

[core] add sleep and wake up endpoint and v1 support (#12987) ...

Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: cennn <2523403608@qq.com>
Co-authored-by: cennn <2523403608@qq.com>

2025-02-20 12:41:17 +08:00

..

__init__.py

[V1][Core] Generic mechanism for handling engine utility (#13060)

2025-02-19 17:09:22 +08:00

async_llm.py

[core] add sleep and wake up endpoint and v1 support (#12987)

2025-02-20 12:41:17 +08:00

core_client.py

[core] add sleep and wake up endpoint and v1 support (#12987)

2025-02-20 12:41:17 +08:00

core.py

[core] add sleep and wake up endpoint and v1 support (#12987)

2025-02-20 12:41:17 +08:00

detokenizer.py

[V1] Logprobs and prompt logprobs support (#9880)

2025-02-07 07:26:20 -08:00

llm_engine.py

[core] add sleep and wake up endpoint and v1 support (#12987)

2025-02-20 12:41:17 +08:00

logprobs.py

[V1] Logprobs and prompt logprobs support (#9880)

2025-02-07 07:26:20 -08:00

mm_input_cache.py

[V1] Consolidate MM cache size to vllm.envs (#13239)

2025-02-13 20:19:03 -08:00

output_processor.py

[Bug] [V1] Try fetching stop_reason from EngineOutput before checking the request (#13108)

2025-02-12 02:39:16 -08:00

processor.py

[V1] Clarify input processing and multimodal feature caching logic (#13211)

2025-02-13 03:43:24 -08:00