Chengji Yao 40d86ee412

[TPU][Bugfix] fix OOM issue in CI test (#21550) ...

Signed-off-by: Chengji Yao <chengjiyao@google.com>

2025-07-24 23:01:53 -07:00

..

attention

[Attention] Optimize FlashInfer MetadataBuilder Build call (#21137)

2025-07-24 03:21:46 -07:00

core

[v1][Core] Clean up usages of SpecializedManager (#21407)

2025-07-24 00:40:11 -07:00

e2e

[Meta] Llama4 EAGLE Support (#20591)

2025-07-15 21:14:15 -07:00

engine

[DP] Internal Load Balancing Per Node [one-pod-per-node] (#21238)

2025-07-23 20:57:32 -07:00

entrypoints

[Tests] Add tests for headless internal DP LB (#21450)

2025-07-23 07:49:25 -07:00

kv_connector

[P/D] Support CPU Transfer in NixlConnector (#18293)

2025-07-24 17:58:42 +01:00

metrics

Enable v1 metrics tests (#20953)

2025-07-20 03:22:02 +00:00

sample

[Sampler] Introduce logprobs mode for logging (#21398)

2025-07-23 01:39:25 -07:00

shutdown

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

spec_decode

[Attention] Refactor attention metadata builder interface (#20466)

2025-07-17 04:44:25 +00:00

structured_output

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

tpu

[TPU][Bugfix] fix OOM issue in CI test (#21550)

2025-07-24 23:01:53 -07:00

worker

[Core] Add reload_weights RPC method (#20096)

2025-07-23 14:24:52 -07:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

test_async_llm_dp.py

[DP] Fix Prometheus Logging (#21257)

2025-07-21 09:11:35 -07:00

test_external_lb_dp.py

[CI] update typos config for CI pre-commit and fix some spells (#20919)

2025-07-15 21:12:40 -07:00

test_hybrid_lb_dp.py

[DP] Support api-server-count > 0 in hybrid DP LB mode (#21510)

2025-07-24 20:18:16 -07:00

test_internal_lb_dp.py

[Tests] Add tests for headless internal DP LB (#21450)

2025-07-23 07:49:25 -07:00

test_metrics_reader.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_oracle.py

[Misc] unify variable for LLM instance (#20996)

2025-07-21 12:18:33 +01:00

test_request.py

[Misc] Add SPDX-FileCopyrightText (#20428)

2025-07-04 07:40:42 +00:00

test_serial_utils.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_utils.py

[Tests] Add tests for headless internal DP LB (#21450)

2025-07-23 07:49:25 -07:00