Lu Fang bb78fb318e

[v1] Support allowed_token_ids in v1 Sampler (#13210) ...

Signed-off-by: Lu Fang <lufang@fb.com>

2025-02-22 14:13:05 +08:00

..

__init__.py

[V1][Core] Generic mechanism for handling engine utility (#13060)

2025-02-19 17:09:22 +08:00

async_llm.py

[core] add sleep and wake up endpoint and v1 support (#12987)

2025-02-20 12:41:17 +08:00

core_client.py

[core] add sleep and wake up endpoint and v1 support (#12987)

2025-02-20 12:41:17 +08:00

core.py

[core] add sleep and wake up endpoint and v1 support (#12987)

2025-02-20 12:41:17 +08:00

detokenizer.py

[V1] Logprobs and prompt logprobs support (#9880)

2025-02-07 07:26:20 -08:00

llm_engine.py

[core] add sleep and wake up endpoint and v1 support (#12987)

2025-02-20 12:41:17 +08:00

logprobs.py

[V1] Logprobs and prompt logprobs support (#9880)

2025-02-07 07:26:20 -08:00

mm_input_cache.py

[V1] Consolidate MM cache size to vllm.envs (#13239)

2025-02-13 20:19:03 -08:00

output_processor.py

[Bug] [V1] Try fetching stop_reason from EngineOutput before checking the request (#13108)

2025-02-12 02:39:16 -08:00

processor.py

[v1] Support allowed_token_ids in v1 Sampler (#13210)

2025-02-22 14:13:05 +08:00