Nick Hill 7df331c66b

[BugFix] Fix chunked prompt logprobs + preemption (#29071)

2025-11-22 16:07:18 -05:00

..

attention

[Attention] Refactor FA block_size limitations to hybrid models only (#29084)

2025-11-22 06:38:44 -08:00

core

[Misc] Further clean up chunked prefill and prefix caching init (#29186)

2025-11-22 19:34:15 +08:00

cudagraph

…

determinism

[CI] Add batch invariant test to ci (#27842)

2025-11-21 09:20:33 -07:00

distributed

[Test] Add non-MoE DP test coverage (#28235)

2025-11-06 20:59:57 +00:00

e2e

[Misc] remove useless v1 env (#29164)

2025-11-21 01:41:20 -08:00

ec_connector

[Doc]: fix typos in various files (#29010)

2025-11-19 04:56:21 -08:00

engine

[Chore] Rename SchedulerConfig.chunked_prefill_enabled (#28735)

2025-11-14 18:39:57 +00:00

entrypoints

Default model load/config/tokenizer to mistral format if relevant files exist (#28659)

2025-11-21 13:58:59 -08:00

executor

[Core] Simplify async KV output aggregation (#28327)

2025-11-09 09:44:13 -08:00

kv_connector

[CI/Build] Skip tests that require libcudart in test_lmcache_integration.py (#29228)

2025-11-22 10:59:39 +00:00

kv_offload

[CI/Build Don't add FLASHINFER backend in test_cpu_offloading.py (#29229)

2025-11-22 11:00:54 +00:00

logits_processors

[Bugfix] Validate custom logits processor xargs for online serving (#27560)

2025-11-05 16:53:33 +00:00

metrics

[Metrics] Refactor LoRA state tracking (#26801)

2025-11-10 16:34:36 +08:00

sample

[BugFix] Fix chunked prompt logprobs + preemption (#29071)

2025-11-22 16:07:18 -05:00

shutdown

…

spec_decode

Revert "[Redo] #26368 (#28771)" (#29121)

2025-11-20 21:27:45 -08:00

structured_output

[Bugfix] Fix llguidance backend, rollback when EOS was encountered (#25905)

2025-11-10 14:53:32 -05:00

tpu

…

tracing

…

worker

[Attention] Refactor FA block_size limitations to hybrid models only (#29084)

2025-11-22 06:38:44 -08:00

__init__.py

…

test_oracle.py

[V0 deprecation]clean up is_v1_supported_oracle (#28116)

2025-11-06 16:05:32 +08:00

test_outputs.py

Fix cu_num_generated_tokens slicing logic in LogprobsLists.slice() method (#28214)

2025-11-09 19:11:46 +00:00

test_request.py

…

test_serial_utils.py

…

utils.py

…