kourosh hakhamaneshi 9fe98d4250

[Frontend] Add request_id to the Request object so they can be controlled better via external load balancers (#21009) ...

Signed-off-by: Kourosh Hakhamaneshi <kourosh@anyscale.com>

2025-07-25 06:49:11 -07:00

..

cli

[DP] Support api-server-count > 0 in hybrid DP LB mode (#21510)

2025-07-24 20:18:16 -07:00

openai

[Frontend] Add request_id to the Request object so they can be controlled better via external load balancers (#21009)

2025-07-25 06:49:11 -07:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

api_server.py

[Frontend] Make TIMEOUT_KEEP_ALIVE configurable through env var (#18472)

2025-06-09 21:41:21 +00:00

chat_utils.py

Add think chunk (#21333)

2025-07-23 21:51:32 -07:00

launcher.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

llm.py

[V1] Get supported tasks from model runner instead of model config (#21585)

2025-07-25 05:36:45 -07:00

logger.py

[V0 Deprecation] Remove Prompt Adapters (#20588)

2025-07-23 16:36:48 -07:00

score_utils.py

[Docs] Lazy import gguf (#20785)

2025-07-10 16:06:37 -07:00

ssl.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

utils.py

[frontend] Add --help=page option for paginated help output (#20961)

2025-07-15 00:42:00 -07:00