Pleaplusone ca00b1bfc6

[ROCm][BugFix] Remove the usage of device_info from aiter (#28383) ...

Signed-off-by: ganyi <ygan@amd.com>

2025-11-12 21:43:42 -08:00

..

attention

[ROCm][BugFix] Remove the usage of device_info from aiter (#28383)

2025-11-12 21:43:42 -08:00

core

[BugFix] Priority scheduling and spec tokens preemption (#28558)

2025-11-12 20:29:21 +00:00

engine

[n-gen] DO NOT repeatedly return finished child requests (#28591)

2025-11-13 03:36:07 +00:00

executor

[Misc] Cleanup Executor interface (#28441)

2025-11-11 22:28:07 +00:00

kv_offload

Implement ARC KV cache eviction policy for CPU offloader (#27039)

2025-11-12 09:51:39 -08:00

metrics

[Metrics] Refactor LoRA state tracking (#26801)

2025-11-10 16:34:36 +08:00

pool

…

sample

[Performance] Cache loaded custom logitsprocs to avoid overheads (#28462)

2025-11-11 16:49:29 -08:00

spec_decode

Rename clashing method names for vLLM model protocol (#27583)

2025-11-12 19:14:33 -08:00

structured_output

[Bugfix] Fix llguidance backend, rollback when EOS was encountered (#25905)

2025-11-10 14:53:32 -05:00

worker

Rename clashing method names for vLLM model protocol (#27583)

2025-11-12 19:14:33 -08:00

__init__.py

…

cudagraph_dispatcher.py

…

kv_cache_interface.py

[Hybrid] Pass kernel block size to builders (#27753)

2025-11-03 05:48:03 +00:00

outputs.py

[Core] Encoder separation for Encode-Prefill-Decode Disaggregation (#25233)

2025-11-11 18:58:33 -08:00

request.py

[Feature]: Add corrupted request metric to V1 metrics system. (#27306)

2025-11-05 13:45:29 -08:00

serial_utils.py

[Misc] Clean up more utils (#27567)

2025-10-27 15:30:38 +00:00

utils.py

[Misc] Clean up more utils (#27567)

2025-10-27 15:30:38 +00:00