Nick Hill 7765e5ba75

[BugFix] Fix PP performance and PP kv connector output regression (#28768) ...

Signed-off-by: Nick Hill <nhill@redhat.com>

2025-11-17 14:08:50 -08:00

..

attention

[ROCm][Qwen3-32B] Fix AITER MHA accuracy issue cause by #25763 (#28670)

2025-11-16 20:52:11 -08:00

core

[Core] Async Scheduling X Spec Decoding Compatibility (#24799)

2025-11-17 12:16:20 -08:00

engine

[BugFix] Fix PP performance and PP kv connector output regression (#28768)

2025-11-17 14:08:50 -08:00

executor

[BugFix] Fix PP performance and PP kv connector output regression (#28768)

2025-11-17 14:08:50 -08:00

kv_offload

Implement ARC KV cache eviction policy for CPU offloader (#27039)

2025-11-12 09:51:39 -08:00

metrics

[Metrics] Fix KV cache usage percent metric multiproc (#28792)

2025-11-17 09:54:15 +00:00

pool

…

sample

[Core] Async Scheduling X Spec Decoding Compatibility (#24799)

2025-11-17 12:16:20 -08:00

spec_decode

[Core] Async Scheduling X Spec Decoding Compatibility (#24799)

2025-11-17 12:16:20 -08:00

structured_output

[Bugfix] Fix llguidance backend, rollback when EOS was encountered (#25905)

2025-11-10 14:53:32 -05:00

worker

[BugFix] Fix PP performance and PP kv connector output regression (#28768)

2025-11-17 14:08:50 -08:00

__init__.py

…

cudagraph_dispatcher.py

…

kv_cache_interface.py

[Hybrid] Pass kernel block size to builders (#27753)

2025-11-03 05:48:03 +00:00

outputs.py

[Redo] #26368 (#28771)

2025-11-14 22:47:41 -08:00

request.py

[Model] Allow users to control skip reading cache per request. (#28194)

2025-11-16 00:04:50 -08:00

serial_utils.py

[DisaggEverything] Tokens in<>out /generate endpoint (#24261)

2025-11-14 09:58:01 -07:00

utils.py

[BugFix] Fix async scheduling + chunked prefill + preemption (#28787)

2025-11-17 06:46:46 +08:00