Chenguang Zheng d765cf01fe

[Core][Multimodal] Track encode cache entries by mm_hash and enable embedding sharing between requests (#22711) ...

Signed-off-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

2025-08-25 00:41:17 -07:00

..

worker

[Core][Multimodal] Track encode cache entries by mm_hash and enable embedding sharing between requests (#22711)

2025-08-25 00:41:17 -07:00

__init__.py

[V1] TPU - Add tensor parallel support via Ray (#13618)

2025-03-08 08:19:38 -05:00

test_basic.py

[TPU][Test] Rollback PR-21550. (#21619)

2025-07-25 13:22:01 -07:00

test_kv_cache_update_kernel.py

[TPU] kv cache update kernel doesn't need to be padded slices to multiple of num_slices_per_block (#22394)

2025-08-09 20:49:04 -07:00

test_mha_attn.py

[V0 Deprecation][TPU] Remove V1 flag check from tests (#22248)

2025-08-05 06:53:23 -07:00

test_multimodal.py

[V0 Deprecation][TPU] Remove V1 flag check from tests (#22248)

2025-08-05 06:53:23 -07:00

test_pallas.py

[TPU] support fp8 kv cache quantization (#19292)

2025-07-20 03:01:00 +00:00

test_perf.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_sampler.py

[V0 Deprecation][TPU] Remove V1 flag check from tests (#22248)

2025-08-05 06:53:23 -07:00

test_spmd_model_weight_loading.py

[Misc] Add SPDX-FileCopyrightText (#20428)

2025-07-04 07:40:42 +00:00

test_topk_topp_sampler.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_tpu_int8.py

[TPU] Add support for online w8a8 quantization (#22425)

2025-08-08 23:12:54 -07:00

test_tpu_qkv_linear.py

[Misc] Add SPDX-FileCopyrightText (#20428)

2025-07-04 07:40:42 +00:00