Chauncey 93b9d9f499

[Bugfix]: Fix messy code when using logprobs (#19209) ...

Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>

2025-07-08 11:02:15 +08:00

..

core

[Structured Outputs][V1] Skipping with models doesn't contain tokenizers (#20365)

2025-07-04 15:05:49 +08:00

e2e

[CI] change spell checker from codespell to typos (#18711)

2025-06-11 19:57:10 -07:00

engine

[Bugfix]: Fix messy code when using logprobs (#19209)

2025-07-08 11:02:15 +08:00

entrypoints

Implement OpenAI Responses API [1/N] (#20504)

2025-07-06 18:32:13 -07:00

kv_connector

[Optimization] Use Shared CachedRequestData Instance Across All Requests (#20232)

2025-06-30 09:07:50 -07:00

metrics

Fix ValueError: Missing value for tag key(s): model_name,engine. (#19113)

2025-06-04 17:10:45 +08:00

sample

[Misc] Add SPDX-FileCopyrightText (#20428)

2025-07-04 07:40:42 +00:00

shutdown

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

spec_decode

[UT][intel GPU] use current_platform instead of device hardcode in v1 tests (#20169)

2025-07-02 09:06:04 +08:00

structured_output

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

tpu

[Misc] Add SPDX-FileCopyrightText (#20428)

2025-07-04 07:40:42 +00:00

worker

[v1] Re-add fp32 support to v1 engine through FlexAttention (#19754)

2025-07-05 09:41:10 +00:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

test_async_llm_dp.py

[Tests] Update online DP tests to verify that requests are balanced (#20157)

2025-07-03 14:49:13 +08:00

test_external_lb_dp.py

[DP] Support external DP Load Balancer mode (#19790)

2025-07-02 10:21:52 -07:00

test_metrics_reader.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_oracle.py

Enable V1 for Hybrid SSM/Attention Models (#20016)

2025-07-04 17:46:53 +00:00

test_request.py

[Misc] Add SPDX-FileCopyrightText (#20428)

2025-07-04 07:40:42 +00:00

test_serial_utils.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_utils.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00