Matthew Bonanni 145c00a4d3

[Bugfix] change FlashMLA reorder_batch_threshold (#27777) ...

Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>

2025-11-03 15:17:10 -05:00

..

attention

[Bugfix] change FlashMLA reorder_batch_threshold (#27777)

2025-11-03 15:17:10 -05:00

core

[BugFix][LoRA] use adapter_id instead of id field of lora_request (#27728)

2025-11-03 10:08:08 +08:00

engine

[V0 deprecation] Remove VLLM_USE_V1 usage in platform and v1 module (#27798)

2025-11-01 10:17:45 +00:00

executor

[V0 deprecation] Remove VLLM_USE_V1 usage in platform and v1 module (#27798)

2025-11-01 10:17:45 +00:00

kv_offload

[KV offload] Enable CPU KV offload on CUDA alike Platforms (#27770)

2025-10-30 22:10:29 +08:00

metrics

[Fix] Skip record_sleep_state logic in PrometheusStatsLogger if not in dev mode (#27789)

2025-10-30 19:26:27 +00:00

pool

[Chore] Separate out vllm.utils.platform_utils.py (#27374)

2025-10-23 19:08:06 +00:00

sample

[BugFix] Fix mixed penalties batch with async scheduling (#27910)

2025-11-01 10:51:24 -07:00

spec_decode

[Spec Decode] Integrate Suffix Decoding from Arctic Inference (#25784)

2025-11-03 09:23:31 -08:00

structured_output

[Core] Async scheduling + structured outputs compatibility (#26866)

2025-11-01 00:35:04 +00:00

worker

[Spec Decode] Integrate Suffix Decoding from Arctic Inference (#25784)

2025-11-03 09:23:31 -08:00

__init__.py

…

cudagraph_dispatcher.py

[LoRA] LoRA cuda graph specialization (#25914)

2025-10-20 04:21:09 +00:00

kv_cache_interface.py

[Hybrid] Pass kernel block size to builders (#27753)

2025-11-03 05:48:03 +00:00

outputs.py

[AsyncScheduling] Make async overlap work with logprobs (#27615)

2025-10-28 22:35:54 +00:00

request.py

…

serial_utils.py

[Misc] Clean up more utils (#27567)

2025-10-27 15:30:38 +00:00

utils.py

[Misc] Clean up more utils (#27567)

2025-10-27 15:30:38 +00:00