Lucia Fang 9a9fda1423

[Core] Support Local Chunked Attention for Hybrid KV Cache (#19351) ...

Signed-off-by: Lucia Fang <fanglu@fb.com>
Signed-off-by: Lu Fang <fanglu@meta.com>
Signed-off-by: Lu Fang <fanglu@fb.com>
Co-authored-by: Lu Fang <fanglu@meta.com>

2025-07-18 20:48:38 -07:00

..

attention

[Attention] Refactor attention metadata builder interface (#20466)

2025-07-17 04:44:25 +00:00

core

[Core] Support Local Chunked Attention for Hybrid KV Cache (#19351)

2025-07-18 20:48:38 -07:00

e2e

[Meta] Llama4 EAGLE Support (#20591)

2025-07-15 21:14:15 -07:00

engine

[Bugfix]: Fix messy code when using logprobs (#19209)

2025-07-08 11:02:15 +08:00

entrypoints

[Bugfix]: Fix final_res_batch list index out of range error (#21055)

2025-07-17 00:29:09 -07:00

executor

[V1] [KVConnector] Fix MultiprocExecutor worker output aggregation (#21048)

2025-07-17 13:29:45 +08:00

kv_connector

[Attention] MLA - Flashinfer Ragged Prefill (#20034)

2025-07-10 20:17:47 -07:00

metrics

Fix ValueError: Missing value for tag key(s): model_name,engine. (#19113)

2025-06-04 17:10:45 +08:00

sample

[Misc] Add SPDX-FileCopyrightText (#20428)

2025-07-04 07:40:42 +00:00

shutdown

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

spec_decode

[Attention] Refactor attention metadata builder interface (#20466)

2025-07-17 04:44:25 +00:00

structured_output

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

tpu

Use w8a8 quantized matmul Pallas kernel (#19170)

2025-07-15 03:06:33 +00:00

worker

[Core] Add update_config RPC method (#20095)

2025-07-14 00:49:18 +00:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

test_async_llm_dp.py

[Tests] Update online DP tests to verify that requests are balanced (#20157)

2025-07-03 14:49:13 +08:00

test_external_lb_dp.py

[CI] update typos config for CI pre-commit and fix some spells (#20919)

2025-07-15 21:12:40 -07:00

test_metrics_reader.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_oracle.py

Enable V1 for Hybrid SSM/Attention Models (#20016)

2025-07-04 17:46:53 +00:00

test_request.py

[Misc] Add SPDX-FileCopyrightText (#20428)

2025-07-04 07:40:42 +00:00

test_serial_utils.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_utils.py

[MISC] Move bind_kv_cache to worker module (#20900)

2025-07-14 09:40:00 +00:00