kourosh hakhamaneshi 7a8f0a3548 [BugFix] Fix OOM in vLLM replicas by ensuring consistent NCCL memory accounting (#25359) ...

Signed-off-by: Kourosh Hakhamaneshi <kourosh@anyscale.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>

2025-10-03 13:35:54 -07:00

..

__init__.py

[V1] Adding min tokens/repetition/presence/frequence penalties to V1 sampler (#10681)

2024-12-26 19:02:58 +09:00

test_gpu_input_batch.py

[Core] Use CpuGpuBuffer for block table tensors (#24795)

2025-09-16 19:18:06 -07:00

test_gpu_model_runner.py

[Core] Use CpuGpuBuffer for block table tensors (#24795)

2025-09-16 19:18:06 -07:00

test_worker_memory_snapshot.py

[BugFix] Fix OOM in vLLM replicas by ensuring consistent NCCL memory accounting (#25359)

2025-10-03 13:35:54 -07:00