Alec S 65ee97288a

[BugFix] Adding env variable to disable async grammar compilation (#29996) ...

Signed-off-by: Alec Solder <alecs@fb.com>
Signed-off-by: Alec S <10566873+alecsolder@users.noreply.github.com>
Co-authored-by: Alec Solder <alecs@fb.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>

2025-12-05 00:49:37 -08:00

..

attention

[BugFix] Fix DBO assert assert B_block_table == B_q (#29933)

2025-12-04 14:48:54 -05:00

core

[CI/Build][AMD] Use float16 in test_reset_prefix_cache_e2e to avoid accuracy issues (#29997)

2025-12-05 08:42:25 +00:00

cudagraph

[ROCm][CI] Fix test_cudagraph_mode.py Failure For AMD CI (#29808)

2025-12-02 22:54:36 +00:00

determinism

[Perf] Optimize batch invariant BMM, 18.1% Throughput improvement, 10.7% TTFT improvement (#29345)

2025-11-26 09:38:52 -07:00

distributed

Mark DBO test as flaky on b200 for Distributed B200 test (#29913)

2025-12-04 10:38:03 -05:00

e2e

[CI][ROCm][tests/v1/e2e] Fix multiprocessing launch for the test (#29123)

2025-12-02 20:46:10 +00:00

ec_connector

[Bugfix] Fix pre-commit (#29601)

2025-11-27 02:23:06 -08:00

engine

[Core] Add xxHash as a high-performance hash option for accelerating prefix caching (#29163)

2025-12-03 16:06:57 +00:00

entrypoints

[Misc] Various cleanups for MM input processing (#29970)

2025-12-04 06:22:20 +00:00

executor

[Core] Simplify async KV output aggregation (#28327)

2025-11-09 09:44:13 -08:00

kv_connector

[CI/Build][AMD] Skip test_shared_storage_connector_hashes in test_shared_storage_connector.py due to hipErrorLaunchFailure when calling .cpu() (#29839)

2025-12-03 22:56:35 +08:00

kv_offload

[ROCm][CI] Fix test_cpu_offloading for ROCm (#29548)

2025-11-27 07:54:44 +00:00

logits_processors

[ROCm][CI] Fix v1/logits_processors failure on ROCm (#29927)

2025-12-04 01:17:07 +08:00

metrics

[Metrics] Refactor LoRA state tracking (#26801)

2025-11-10 16:34:36 +08:00

sample

[CI] Fix Bad_words test for tokenizer encode/decode asymmetry (#28193)

2025-12-02 00:02:12 -08:00

shutdown

…

spec_decode

[Rocm][CI] Fix test_speculator_eagle3 by skipping the CompressedTensorw4a16 Model (#30001)

2025-12-04 07:52:28 +00:00

structured_output

[BugFix] Adding env variable to disable async grammar compilation (#29996)

2025-12-05 00:49:37 -08:00

tpu

Remove default values from InitVars so that they're not stored (#29859)

2025-12-02 12:16:37 +00:00

tracing

…

worker

[CI/Build][AMD] Skip test on test_hybrid_attention_mamba_tensor_shapes on ROCm, requires FLASHINFER (#29995)

2025-12-04 09:30:22 +00:00

__init__.py

…

test_oracle.py

…

test_outputs.py

[BugFix] Fix spec decoding max_tokens scheduling perf issue (#29542)

2025-11-28 20:52:23 +08:00

test_request.py

…

test_serial_utils.py

…

utils.py

…