Kyuyeun Kim 9a0c5ded5a

[TPU] Add support for online w8a8 quantization (#22425) ...

Signed-off-by: Kyuyeun Kim <kyuyeunk@google.com>

2025-08-08 23:12:54 -07:00

..

attention

[ROCm] [V1] [SpecDec] Enable Speculative Decoding on ROCm V1 Engine (#21496)

2025-08-07 19:13:17 -07:00

core

Revert "[Bugfix] V1 Fix the cursor leakage issue during request scheduling." (#22223)

2025-08-04 18:37:06 -07:00

e2e

[ROCm] [V1] [SpecDec] Enable Speculative Decoding on ROCm V1 Engine (#21496)

2025-08-07 19:13:17 -07:00

engine

[Bugfix] fix when skip tokenizer init (#21922)

2025-08-01 10:09:36 -07:00

entrypoints

[Bugfix] Fix RuntimeError: Index put requires the source and destination dtypes match (#22065)

2025-08-07 19:20:21 -07:00

kv_connector

[CI Bugfix] Fix wNa16 kernel not found for test_shared_storage_connector_hashes (#22163)

2025-08-03 22:19:04 -07:00

metrics

Enable v1 metrics tests (#20953)

2025-07-20 03:22:02 +00:00

sample

[Sampler] Support returning all logprobs or logits (#21792)

2025-08-04 03:04:12 -07:00

shutdown

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

spec_decode

[ROCm] [V1] [SpecDec] Enable Speculative Decoding on ROCm V1 Engine (#21496)

2025-08-07 19:13:17 -07:00

structured_output

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

tpu

[TPU] Add support for online w8a8 quantization (#22425)

2025-08-08 23:12:54 -07:00

worker

[Attention] Support multiple attention metadata builders per kv_cache_spec + proper local attention no hybrid kv cache fix (#21588)

2025-08-06 18:40:52 -07:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

test_async_llm_dp.py

Deprecate --disable-log-requests and replace with --enable-log-requests (#21739)

2025-08-01 17:16:37 +01:00

test_external_lb_dp.py

[Tests] Harden DP tests (#21508)

2025-07-25 02:27:24 -07:00

test_hybrid_lb_dp.py

[Tests] Harden DP tests (#21508)

2025-07-25 02:27:24 -07:00

test_internal_lb_dp.py

[Tests] Harden DP tests (#21508)

2025-07-25 02:27:24 -07:00

test_metrics_reader.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_oracle.py

[v1] - Mamba1 Attention Metadata (#21249)

2025-08-06 17:03:42 -07:00

test_request.py

[Misc] Add SPDX-FileCopyrightText (#20428)

2025-07-04 07:40:42 +00:00

test_serial_utils.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_utils.py

Support encoder-only models without KV-Cache (#21270)

2025-07-26 21:09:52 +08:00