Adrian Abeyta a5a790eea6

[Bugfix] Ensure calculated KV scales are applied in attention. (#27232) ...

Signed-off-by: adabeyta <aabeyta@redhat.com>

2025-11-10 23:42:37 +00:00

..

attention

[RFC][ROCm][AITER] Keep all AITER kernels in _aiter_ops class like _custom_ops and _ipex_ops (#24490)

2025-11-10 08:20:53 -08:00

core

[Misc] Add more scoping for improved trace (#28329)

2025-11-10 21:03:21 +00:00

engine

[Perf] Move gc.freeze logic from EngineCoreProc to EngineCore for better coverage (#27896)

2025-11-10 15:34:18 -08:00

executor

[Core] Simplify async KV output aggregation (#28327)

2025-11-09 09:44:13 -08:00

kv_offload

[KV offload] Enable CPU KV offload on CUDA alike Platforms (#27770)

2025-10-30 22:10:29 +08:00

metrics

[Metrics] Refactor LoRA state tracking (#26801)

2025-11-10 16:34:36 +08:00

pool

[Chore] Separate out vllm.utils.platform_utils.py (#27374)

2025-10-23 19:08:06 +00:00

sample

[CPU]Avoid repeated random sample compile (#28260)

2025-11-07 11:03:57 +00:00

spec_decode

[BugFix] Support EP/DP + EPLB with MTP (#25311)

2025-11-05 15:22:17 +00:00

structured_output

[Bugfix] Fix llguidance backend, rollback when EOS was encountered (#25905)

2025-11-10 14:53:32 -05:00

worker

[Bugfix] Ensure calculated KV scales are applied in attention. (#27232)

2025-11-10 23:42:37 +00:00

__init__.py

…

cudagraph_dispatcher.py

…

kv_cache_interface.py

[Hybrid] Pass kernel block size to builders (#27753)

2025-11-03 05:48:03 +00:00

outputs.py

Fix cu_num_generated_tokens slicing logic in LogprobsLists.slice() method (#28214)

2025-11-09 19:11:46 +00:00

request.py

[Feature]: Add corrupted request metric to V1 metrics system. (#27306)

2025-11-05 13:45:29 -08:00

serial_utils.py

[Misc] Clean up more utils (#27567)

2025-10-27 15:30:38 +00:00

utils.py

[Misc] Clean up more utils (#27567)

2025-10-27 15:30:38 +00:00