youkaichao ba81163997

[core] add sleep and wake up endpoint and v1 support (#12987) ...

Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: cennn <2523403608@qq.com>
Co-authored-by: cennn <2523403608@qq.com>

2025-02-20 12:41:17 +08:00

..

__init__.py

[CI/Build] Move test_utils.py to tests/utils.py (#4425)

2024-05-13 23:50:09 +09:00

test_basic_correctness.py

[1/n][CI] Load models in CI from S3 instead of HF (#13205)

2025-02-19 07:34:59 +00:00

test_chunked_prefill.py

[Core] Reduce TTFT with concurrent partial prefills (#10235)

2025-02-14 15:36:07 -08:00

test_cpu_offload.py

Consolidate Llama model usage in tests (#13094)

2025-02-13 22:18:03 -08:00

test_cumem.py

[core] add sleep and wake up endpoint and v1 support (#12987)

2025-02-20 12:41:17 +08:00

test_preemption.py

[1/n][CI] Load models in CI from S3 instead of HF (#13205)

2025-02-19 07:34:59 +00:00