Matthew Bonanni fc1d8be3dc

[Attention] Update attention imports (#29540) ...

Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>

2025-11-27 11:19:09 -05:00

..

attention

[Attention] Update attention imports (#29540)

2025-11-27 11:19:09 -05:00

core

[Core] Support logprobs with spec decode + async scheduling (#29223)

2025-11-25 12:55:24 -08:00

engine

Scheduled removal of override_pooler_config and disable_log_requests (#29402)

2025-11-25 16:08:57 +00:00

executor

[Feature] Prefill Context Parallel (PCP) basic support (#28718)

2025-11-19 15:52:44 -05:00

kv_offload

[Attention] Update attention imports (#29540)

2025-11-27 11:19:09 -05:00

metrics

[Metrics] Scheduled removal of deprecated metrics (#29330)

2025-11-25 11:15:13 +08:00

pool

…

sample

[Doc]: fixing typos in diverse files (#29492)

2025-11-27 07:15:50 -08:00

spec_decode

[Attention] Update attention imports (#29540)

2025-11-27 11:19:09 -05:00

structured_output

[Bugfix] Fix llguidance backend, rollback when EOS was encountered (#25905)

2025-11-10 14:53:32 -05:00

worker

[Attention] Update attention imports (#29540)

2025-11-27 11:19:09 -05:00

__init__.py

…

cudagraph_dispatcher.py

[Core] Refactor padding logic and pad for CUDA graphs before attention metadata building (#28579)

2025-11-26 14:07:13 -05:00

kv_cache_interface.py

[Feature] Prefill Context Parallel (PCP) basic support (#28718)

2025-11-19 15:52:44 -05:00

outputs.py

Revert "[Redo] #26368 (#28771)" (#29121)

2025-11-20 21:27:45 -08:00

request.py

[KV Connector] Fix async connector prefix cache metrics (#28585)

2025-11-21 17:45:00 -05:00

serial_utils.py

[DisaggEverything] Tokens in<>out /generate endpoint (#24261)

2025-11-14 09:58:01 -07:00

utils.py

[BugFix] Fix async scheduling + chunked prefill + preemption (#28787)

2025-11-17 06:46:46 +08:00