Amir Samani aeac905e6f

Merge branch 'main' into pynccl_symm_fix

2025-11-25 15:15:19 -08:00

..

attention

[ROCm][CI] Fix test_cudagraph_mode failure in AMD CI (#29367)

2025-11-25 07:55:09 +00:00

core

[Hybrid Allocator] Support KV cache groups with different block_size (#29143)

2025-11-25 10:30:57 -05:00

cudagraph

Merge branch 'main' into pynccl_symm_fix

2025-11-25 10:31:22 -08:00

determinism

[CI] Add batch invariant test to ci (#27842)

2025-11-21 09:20:33 -07:00

distributed

EAGLE Support DP>1 (#26086)

2025-11-25 07:32:21 +00:00

e2e

[Core] Support logprobs with spec decode + async scheduling (#29223)

2025-11-25 12:55:24 -08:00

ec_connector

[Doc]: fix typos in various files (#29010)

2025-11-19 04:56:21 -08:00

engine

[Chore] Rename SchedulerConfig.chunked_prefill_enabled (#28735)

2025-11-14 18:39:57 +00:00

entrypoints

Scheduled removal of guided_* config fields (#29326)

2025-11-25 05:24:05 +00:00

executor

[Core] Simplify async KV output aggregation (#28327)

2025-11-09 09:44:13 -08:00

kv_connector

[CI/Build][AMD] Skip test_multi_shared_storage_connector_consistency in test_multi_connector.py due to hipErrorLaunchFailure when calling .cpu() (#29253)

2025-11-23 04:42:49 +00:00

kv_offload

[CI/Build Don't add FLASHINFER backend in test_cpu_offloading.py (#29229)

2025-11-22 11:00:54 +00:00

logits_processors

[Bugfix] Validate custom logits processor xargs for online serving (#27560)

2025-11-05 16:53:33 +00:00

metrics

[Metrics] Refactor LoRA state tracking (#26801)

2025-11-10 16:34:36 +08:00

sample

[BugFix] Fix chunked prompt logprobs + preemption (#29071)

2025-11-22 16:07:18 -05:00

shutdown

…

spec_decode

[CI/Build][AMD] Add check for flash_att_varlen_func to test_tree_attention.py (#29252)

2025-11-23 04:45:08 +00:00

structured_output

[Bugfix] Fix llguidance backend, rollback when EOS was encountered (#25905)

2025-11-10 14:53:32 -05:00

tpu

[Core] Async scheduling + structured outputs compatibility (#26866)

2025-11-01 00:35:04 +00:00

tracing

…

worker

[Attention] Refactor FA block_size limitations to hybrid models only (#29084)

2025-11-22 06:38:44 -08:00

__init__.py

…

test_oracle.py

[V0 deprecation]clean up is_v1_supported_oracle (#28116)

2025-11-06 16:05:32 +08:00

test_outputs.py

Fix cu_num_generated_tokens slicing logic in LogprobsLists.slice() method (#28214)

2025-11-09 19:11:46 +00:00

test_request.py

…

test_serial_utils.py

…

utils.py

…