Rachel Guo 467bef18a3

[BugFix][FlashInfer] Fix attention backend interface mismatch with unexpected keyword use_irope (#19134) ...

Signed-off-by: Yunqiu Guo <guorachel@meta.com>

2025-06-10 16:48:51 +08:00

..

attention

[BugFix][FlashInfer] Fix attention backend interface mismatch with unexpected keyword use_irope (#19134)

2025-06-10 16:48:51 +08:00

core

[Core] Use tuple for kv cache group block ids (#19175)

2025-06-10 07:01:17 +02:00

engine

[Bugfix][Core] Update cancellation logic in generate() to handle Generator exits (#19225)

2025-06-06 20:17:54 +00:00

executor

[Multi Modal] Add an env var for message queue max chunk bytes (#19242)

2025-06-08 21:39:12 +08:00

metrics

Fix ValueError: Missing value for tag key(s): model_name,engine. (#19113)

2025-06-04 17:10:45 +08:00

sample

improve logits bias (#19041)

2025-06-06 19:59:25 +08:00

spec_decode

[Bugfix] Fix EAGLE vocab embedding construction for Llama 70B (#19033)

2025-06-05 19:10:08 -07:00

structured_output

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

worker

Automatically bind CPU OMP Threads of a rank to CPU ids of a NUMA node. (#17930)

2025-06-10 06:22:05 +00:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

kv_cache_interface.py

[v1] Hybrid Memory Allocator (#17996)

2025-06-05 20:47:09 -07:00

outputs.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

request.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

serial_utils.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

utils.py

[Bugfix]: Fix TypeError: 'float' object cannot be interpreted as an integer (#19283)

2025-06-08 08:16:31 +08:00