Yihua Cheng 94a9ebcf31

[KV connector][WIP] KV cache proxy based on LMCache multi-process mode (#27902) ...

Signed-off-by: ApostaC <yihua98@uchicago.edu>

2025-11-12 20:25:43 +00:00

..

device_communicators

[BugFix] Graceful handling of torch symm mem errors. (#27671)

2025-11-11 17:41:54 -07:00

ec_transfer

[CI/Build] Fix crash due to removed VLLM_USE_V1 attribute in EPD (#28521)

2025-11-11 23:09:33 -08:00

eplb

[EPLB] Refactor balance_packing to use numpy and optimize GPU-CPU transfers in EPLB (#28369)

2025-11-11 00:19:51 -08:00

kv_transfer

[KV connector][WIP] KV cache proxy based on LMCache multi-process mode (#27902)

2025-11-12 20:25:43 +00:00

__init__.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

communication_op.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

kv_events.py

Fix EventPublisherFactory logic for disabled KV cache events (#27419)

2025-10-24 05:00:01 +00:00

parallel_state.py

[Perf] Move gc.freeze logic from EngineCoreProc to EngineCore for better coverage (#27896)

2025-11-10 15:34:18 -08:00

tpu_distributed_utils.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

utils.py

[Chore] Separate out vllm.utils.network_utils (#27164)

2025-10-19 03:06:32 -07:00